[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:42 dist-test-slave-1nl6 krb5kdc[20088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:42 dist-test-slave-1nl6 krb5kdc[20088](info): set up 2 sockets
Aug 11 18:53:42 dist-test-slave-1nl6 krb5kdc[20088](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 18:53:43.373029 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:53:43 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:53:43.558840 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46477
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:43.889555 20109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:43.889920 20109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:43.890012 20109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:43.897035 20109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:43.897142 20109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:43.897189 20109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:43.897249 20109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:43.897289 20109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:43.906958 20109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:43.908268 20109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:43.909548 20109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:43.923203 20123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:43.923069 20127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:43.923106 20124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:43.923905 20109 server_base.cc:1034] running on GCE node
I20260811 18:53:43.924757 20109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:43.926182 20109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:43.927420 20109 hybrid_clock.cc:648] HybridClock initialized: now 1786474423927391 us; error 96 us; skew 500 ppm
I20260811 18:53:43.927776 20109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:43 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474423, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:43.931119 20109 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:53:43.932616 20109 webserver.cc:460] Webserver started at http://127.19.155.254:43955/ using document root <none> and password file <none>
I20260811 18:53:43.933315 20109 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:43.933477 20109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:43.933799 20109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:43.937034 20109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "0ea2e140023748cc91da62d319e1e9f1"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-1nl6"
server_key: "6963660af1b2ad632f89d8fda9dafd40"
server_key_iv: "9b6d5d75bc57214b084b285385a93295"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.937836 20109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "0ea2e140023748cc91da62d319e1e9f1"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-1nl6"
server_key: "6963660af1b2ad632f89d8fda9dafd40"
server_key_iv: "9b6d5d75bc57214b084b285385a93295"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.943267 20109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260811 18:53:43.946758 20138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:43.948033 20109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:43.948262 20109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "0ea2e140023748cc91da62d319e1e9f1"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-1nl6"
server_key: "6963660af1b2ad632f89d8fda9dafd40"
server_key_iv: "9b6d5d75bc57214b084b285385a93295"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.948472 20109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:43.969301 20109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:43.973567 20109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:43.973881 20109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:43.993448 20109 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46477
I20260811 18:53:43.993486 20233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46477 every 8 connection(s)
I20260811 18:53:43.994946 20109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:43.998773 20234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:44.005719 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20109
I20260811 18:53:44.006040 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:53:44.008028 20079 external_mini_cluster.cc:1428] Setting key 43494c20db98874905a3f2d783f0d76a
I20260811 18:53:44.009073 20234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1: Bootstrap starting.
I20260811 18:53:44.013069 20234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:44.014472 20234 log.cc:824] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:44.017449 20234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1: No bootstrap required, opened a new log
I20260811 18:53:44.025779 20234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } }
I20260811 18:53:44.026208 20234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:44.026356 20234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea2e140023748cc91da62d319e1e9f1, State: Initialized, Role: FOLLOWER
I20260811 18:53:44.027127 20234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } }
I20260811 18:53:44.027411 20234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:44.027571 20234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:44.027781 20234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:44.029984 20234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } }
I20260811 18:53:44.030529 20234 leader_election.cc:302] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ea2e140023748cc91da62d319e1e9f1; no voters:
I20260811 18:53:44.031296 20234 leader_election.cc:288] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:44.031457 20249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:44.032711 20249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [term 1 LEADER]: Becoming Leader. State: Replica: 0ea2e140023748cc91da62d319e1e9f1, State: Running, Role: LEADER
I20260811 18:53:44.033335 20249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } }
I20260811 18:53:44.033561 20234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:44.036293 20250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ea2e140023748cc91da62d319e1e9f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } } }
I20260811 18:53:44.036665 20250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:44.041168 20251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ea2e140023748cc91da62d319e1e9f1. Latest consensus state: current_term: 1 leader_uuid: "0ea2e140023748cc91da62d319e1e9f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ea2e140023748cc91da62d319e1e9f1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46477 } } }
I20260811 18:53:44.041498 20251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1 [sys.catalog]: This master's current role is: LEADER
Aug 11 18:53:44 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:44.043589 20257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:44.048977 20257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:44.060038 20240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.012017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.19.155.254:46477)
0811 18:53:44.012865 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.012882 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.014256 (+ 1374us) server_negotiation.cc:407] Connection header received
0811 18:53:44.025280 (+ 11024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.025303 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.025684 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.026086 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.029395 (+ 3309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.030818 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.033587 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.034719 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.034973 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.044424 (+ 9451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.044450 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.044478 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:44.044538 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.050230 (+ 5692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:44.051663 (+ 1433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:44.051678 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:44.051689 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:44.052043 (+ 354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:44.052832 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:44.052840 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:44.052846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:44.053932 (+ 1086us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.057379 (+ 3447us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.057720 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.058271 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":403,"threads_started":1}
I20260811 18:53:44.067441 20257 catalog_manager.cc:1347] Generated new cluster ID: ed2e272f16544666a60cc211d7363e2e
I20260811 18:53:44.067556 20257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:44.082248 20257 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:44.083571 20257 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:44.090669 20257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ea2e140023748cc91da62d319e1e9f1: Generated new TSK 0
I20260811 18:53:44.091723 20257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:53:44.144923 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:44.485930 20287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.486263 20287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.486444 20287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.493698 20287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.493844 20287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.494029 20287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:53:44.503707 20287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:44.504985 20287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.506402 20287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.519950 20299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.520017 20300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.520071 20303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.520929 20287 server_base.cc:1034] running on GCE node
I20260811 18:53:44.521507 20287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.522322 20287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.523551 20287 hybrid_clock.cc:648] HybridClock initialized: now 1786474424523506 us; error 53 us; skew 500 ppm
I20260811 18:53:44.523887 20287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:44 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474424, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:44.527011 20287 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:53:44.528491 20287 webserver.cc:460] Webserver started at http://127.19.155.193:40881/ using document root <none> and password file <none>
I20260811 18:53:44.529188 20287 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.529343 20287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.529661 20287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.532630 20287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "eb42ca24c7124e6696efab3e797260c0"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-1nl6"
server_key: "75b365d9f3d43e9b473e2d0d362d4497"
server_key_iv: "97bd900416c5db586bf059aee53a07c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.533473 20287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "eb42ca24c7124e6696efab3e797260c0"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-1nl6"
server_key: "75b365d9f3d43e9b473e2d0d362d4497"
server_key_iv: "97bd900416c5db586bf059aee53a07c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.538688 20287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:53:44.542050 20317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.543316 20287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:44.543489 20287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "eb42ca24c7124e6696efab3e797260c0"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-1nl6"
server_key: "75b365d9f3d43e9b473e2d0d362d4497"
server_key_iv: "97bd900416c5db586bf059aee53a07c2"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.543677 20287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.563362 20287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.567551 20287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.567857 20287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.568811 20287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.570230 20287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.570338 20287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.570492 20287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.570566 20287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.605330 20287 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:44213
I20260811 18:53:44.605422 20554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:44213 every 8 connection(s)
I20260811 18:53:44.606652 20287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:44.615182 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20287
I20260811 18:53:44.615433 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:44.616097 20079 external_mini_cluster.cc:1428] Setting key 5f994ff3d9fe14b16d1407271c076ebd
Aug 11 18:53:44 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474424, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:44.628691 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.609410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57283 (local address 127.19.155.254:46477)
0811 18:53:44.609846 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.609850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.610935 (+ 1085us) server_negotiation.cc:407] Connection header received
0811 18:53:44.612766 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.612771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.612840 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.612946 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.614409 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.615553 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.617129 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.617582 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.617688 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.621465 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.621475 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.621482 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:44.621540 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.625162 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:44.626226 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:44.626229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:44.626232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:44.626348 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:44.626983 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:44.626987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:44.626989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:44.627264 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.627379 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.628262 (+ 883us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.628431 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":213,"threads_started":1}
I20260811 18:53:44.630198 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.610008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46477 (local address 127.19.155.193:57283)
0811 18:53:44.610738 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.610783 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.612487 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.613156 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.613163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.613687 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.614248 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.614265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.615702 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.615707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.616996 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.617009 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.617826 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.617835 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.618043 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.618741 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:44.618767 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.621228 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.625422 (+ 4194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:44.625434 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:44.625453 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:44.626104 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:44.626473 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:44.626480 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:44.626486 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:44.626807 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:44.627413 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.627425 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.627881 (+ 456us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.628190 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.628761 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":283,"threads_started":1}
I20260811 18:53:44.631796 20556 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46477
I20260811 18:53:44.632117 20556 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.632866 20556 heartbeater.cc:511] Master 127.19.155.254:46477 requested a full tablet report, sending...
I20260811 18:53:44.635166 20170 ts_manager.cc:194] Registered new tserver with Master: eb42ca24c7124e6696efab3e797260c0 (127.19.155.193:44213)
I20260811 18:53:44.636621 20170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:57283
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:53:44.663329 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:45.005695 20566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:45.005972 20566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:45.006138 20566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:45.013687 20566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:45.013799 20566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:45.014004 20566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:53:45.024025 20566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:45.025342 20566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:45.026705 20566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:45.040469 20576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:45.040426 20577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:45.040920 20580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:45.041565 20566 server_base.cc:1034] running on GCE node
I20260811 18:53:45.042213 20566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:45.043135 20566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:45.044380 20566 hybrid_clock.cc:648] HybridClock initialized: now 1786474425044326 us; error 34 us; skew 500 ppm
I20260811 18:53:45.044669 20566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:45.048429 20566 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:53:45.049923 20566 webserver.cc:460] Webserver started at http://127.19.155.194:34329/ using document root <none> and password file <none>
I20260811 18:53:45.050632 20566 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:45.050776 20566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:45.051163 20566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:45.054410 20566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "f64f51d17725442789d337b8d5da9f93"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "1e3cd63b9478bcfa5802e5997f2406ac"
server_key_iv: "f72ec9ee92f27fb51788b7f00abcf1f3"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.055262 20566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "f64f51d17725442789d337b8d5da9f93"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "1e3cd63b9478bcfa5802e5997f2406ac"
server_key_iv: "f72ec9ee92f27fb51788b7f00abcf1f3"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.060576 20566 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:53:45.064114 20594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.065464 20566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:45.065632 20566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "f64f51d17725442789d337b8d5da9f93"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "1e3cd63b9478bcfa5802e5997f2406ac"
server_key_iv: "f72ec9ee92f27fb51788b7f00abcf1f3"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.065851 20566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:45.085928 20566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:45.090090 20566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:45.090405 20566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:45.091452 20566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:45.092888 20566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:45.092964 20566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.093149 20566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:45.093205 20566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.128559 20566 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39841
I20260811 18:53:45.128648 20795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39841 every 8 connection(s)
I20260811 18:53:45.130028 20566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:45.131605 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20566
I20260811 18:53:45.131768 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:45.132220 20079 external_mini_cluster.cc:1428] Setting key 3416fc11be5296d07228cfb3550e2c86
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:45.152735 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.133455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:51129 (local address 127.19.155.254:46477)
0811 18:53:45.134004 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.134010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.135077 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 18:53:45.136897 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.136902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.136983 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.137111 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.138719 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.139535 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.141103 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.141834 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.141974 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.146031 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.146036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.146039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.146071 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.149134 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.150105 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.150109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.150111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.150242 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.150785 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.150788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.150790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.151113 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.151225 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.152161 (+ 936us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.152337 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":279,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
I20260811 18:53:45.154072 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.134003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46477 (local address 127.19.155.194:51129)
0811 18:53:45.134904 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:45.134977 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:45.136642 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:45.137455 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:45.137464 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:45.137992 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:45.138543 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:45.138560 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.139701 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.139706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:45.140926 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:45.140938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.142060 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.142066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:45.142267 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.143000 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:45.143027 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:45.145786 (+ 2759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:45.149285 (+ 3499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:45.149297 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:45.149314 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:45.149985 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:45.150364 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:45.150371 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:45.150377 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:45.150666 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:45.151248 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:45.151256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:45.151712 (+ 456us) client_negotiation.cc:769] Sending connection context
0811 18:53:45.152090 (+ 378us) client_negotiation.cc:240] Negotiation successful
0811 18:53:45.152685 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":367,"threads_started":1}
I20260811 18:53:45.155542 20799 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46477
I20260811 18:53:45.155874 20799 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
I20260811 18:53:45.156622 20799 heartbeater.cc:511] Master 127.19.155.254:46477 requested a full tablet report, sending...
I20260811 18:53:45.158465 20170 ts_manager.cc:194] Registered new tserver with Master: f64f51d17725442789d337b8d5da9f93 (127.19.155.194:39841)
I20260811 18:53:45.159794 20170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:51129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:53:45.183121 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:45.516360 20808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:45.516614 20808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:45.516757 20808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:45.523993 20808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:45.524116 20808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:45.524334 20808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:53:45.533921 20808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46477
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:45.535351 20808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:45.536701 20808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:45.550194 20817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:45.550334 20821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:45.550334 20816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:45.551244 20808 server_base.cc:1034] running on GCE node
I20260811 18:53:45.551967 20808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:45.553013 20808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:45.554241 20808 hybrid_clock.cc:648] HybridClock initialized: now 1786474425554168 us; error 58 us; skew 500 ppm
I20260811 18:53:45.554564 20808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:45.558032 20808 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:53:45.559582 20808 webserver.cc:460] Webserver started at http://127.19.155.195:38905/ using document root <none> and password file <none>
I20260811 18:53:45.560386 20808 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:45.560555 20808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:45.560905 20808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:45.564033 20808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "86054845645245d89a6c31257adeb18e"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "4e7ba713a48f28b2f21d04341ef7133e"
server_key_iv: "9d72eb5c71d824f79d7012ef9702eedb"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.564755 20808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "86054845645245d89a6c31257adeb18e"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "4e7ba713a48f28b2f21d04341ef7133e"
server_key_iv: "9d72eb5c71d824f79d7012ef9702eedb"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.569789 20808 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:53:45.573274 20835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.574538 20808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:45.574702 20808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "86054845645245d89a6c31257adeb18e"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-1nl6"
server_key: "4e7ba713a48f28b2f21d04341ef7133e"
server_key_iv: "9d72eb5c71d824f79d7012ef9702eedb"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.574949 20808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:45.588311 20808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:45.592499 20808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:45.592792 20808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:45.593739 20808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:45.595095 20808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:45.595170 20808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.595350 20808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:45.595409 20808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.631421 20808 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:34679
I20260811 18:53:45.631469 21010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:34679 every 8 connection(s)
I20260811 18:53:45.632763 20808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:45.639655 20556 heartbeater.cc:503] Master 127.19.155.254:46477 was elected leader, sending a full tablet report...
I20260811 18:53:45.642073 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20808
I20260811 18:53:45.642282 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:45.642724 20079 external_mini_cluster.cc:1428] Setting key 64518d398ea50298d8372e1e34dd3914
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:45.653424 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.635597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:34997 (local address 127.19.155.254:46477)
0811 18:53:45.635782 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.635787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.636955 (+ 1168us) server_negotiation.cc:407] Connection header received
0811 18:53:45.638842 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.638848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.638983 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.639097 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.640971 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.641854 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.643784 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.644330 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.644490 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.648238 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.648243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.648246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.648277 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.650688 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.651405 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.651409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.651411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.651525 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.651956 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.651960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.651962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.652262 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.652379 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.653021 (+ 642us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.653197 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:53:45.654435 21019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.636049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46477 (local address 127.19.155.195:34997)
0811 18:53:45.636801 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:45.636837 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:45.638554 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:45.639338 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:45.639346 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:45.640104 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:45.640803 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:45.640821 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.642026 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.642036 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:45.643613 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:45.643630 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.644560 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.644565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:45.644767 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.645527 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:45.645550 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:45.648037 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:45.650821 (+ 2784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:45.650828 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:45.650840 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:45.651303 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:45.651623 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:45.651626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:45.651628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:45.651810 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:45.652374 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:45.652380 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:45.652669 (+ 289us) client_negotiation.cc:769] Sending connection context
0811 18:53:45.652890 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 18:53:45.653376 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":322,"threads_started":1}
I20260811 18:53:45.655717 21012 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46477
I20260811 18:53:45.656020 21012 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:45.656735 21012 heartbeater.cc:511] Master 127.19.155.254:46477 requested a full tablet report, sending...
I20260811 18:53:45.658485 20170 ts_manager.cc:194] Registered new tserver with Master: 86054845645245d89a6c31257adeb18e (127.19.155.195:34679)
I20260811 18:53:45.659389 20170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:34997
I20260811 18:53:45.670985 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:45.723158 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.706449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40882 (local address 127.19.155.193:44213)
0811 18:53:45.707153 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.707161 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.709296 (+ 2135us) server_negotiation.cc:407] Connection header received
0811 18:53:45.709439 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.709447 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.709688 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.709830 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.711349 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.712381 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.713579 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.714138 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.714243 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.718030 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.718041 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.718056 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.718085 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.720773 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.721369 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.721376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.721378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.721491 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.721833 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.721836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.721839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.722155 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.722401 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.722623 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.722811 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":354,"threads_started":1}
W20260811 18:53:45.724367 20384 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40882
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:45.773308 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.759343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40896 (local address 127.19.155.193:44213)
0811 18:53:45.759599 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.759606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.759873 (+ 267us) server_negotiation.cc:407] Connection header received
0811 18:53:45.760027 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.760031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.760099 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.760186 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.761630 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.762324 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.763637 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.764068 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.764167 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.768073 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.768079 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.768083 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.768119 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.770780 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.771530 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.771534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.771537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.771665 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.772001 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.772004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.772006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.772274 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.772468 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.772771 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.772949 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 18:53:45.774850 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20287
I20260811 18:53:45.787151 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.775831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.19.155.193:44213)
0811 18:53:45.775988 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.775992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.776416 (+ 424us) server_negotiation.cc:407] Connection header received
0811 18:53:45.776536 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.776540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.776592 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.776671 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.777800 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.778601 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.779967 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.780378 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.780483 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.782449 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.782453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.782456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.782483 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.784930 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.785535 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.785539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.785541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.785685 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.785993 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.785996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.785998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.786238 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.786415 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.786665 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.786808 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:53:45.787827 20549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:45.872226 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20287
I20260811 18:53:45.896423 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20566
Aug 11 18:53:45 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:53:45.912572 21037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.897333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.19.155.194:39841)
0811 18:53:45.897894 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.897901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.897925 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:53:45.897987 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.897993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.898195 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.898395 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.899694 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.900724 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.901964 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:45.902553 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:45.902745 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:45.906811 (+ 4066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.906821 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.906835 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:45.906874 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.909583 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.910227 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.910235 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.910237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.910361 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:45.910796 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:45.910801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:45.910804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:45.911290 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.911608 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.911927 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.912228 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":275,"threads_started":1}
I20260811 18:53:45.913841 20780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:45.996663 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20566
I20260811 18:53:46.020709 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20808
Aug 11 18:53:46 dist-test-slave-1nl6 krb5kdc[20088](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:53:46.037864 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:46.021837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59522 (local address 127.19.155.195:34679)
0811 18:53:46.022486 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:46.022494 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:46.022523 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:53:46.022587 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:46.022594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:46.022810 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:46.023032 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:46.024332 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.025393 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.026680 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.027416 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.027558 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:46.031753 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:46.031765 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:46.031780 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:46.031815 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:46.034659 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.035552 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.035561 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.035563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.035695 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.036085 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.036090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.036095 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.036510 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:46.036849 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:46.037213 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 18:53:46.037505 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":317,"threads_started":1}
I20260811 18:53:46.039247 21006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:46.120806 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20808
I20260811 18:53:46.148557 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20109
I20260811 18:53:46.149765 20225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:46.252970 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20109
2026-08-11T18:53:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4214 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:46 dist-test-slave-1nl6 krb5kdc[21046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:46 dist-test-slave-1nl6 krb5kdc[21046](info): set up 2 sockets
Aug 11 18:53:46 dist-test-slave-1nl6 krb5kdc[21046](info): commencing operation
krb5kdc: starting...
W20260811 18:53:47.572155 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:53:47 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:53:47.762718 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35519
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:35519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:48.103044 21075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:48.103506 21075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:48.103686 21075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:48.117705 21075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:48.117851 21075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:48.117944 21075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:48.118038 21075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:48.118111 21075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:48.134094 21075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:35519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:48.135545 21075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:48.136868 21075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:48.152621 21089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:48.152571 21090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:48.152698 21093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:48.153401 21075 server_base.cc:1034] running on GCE node
I20260811 18:53:48.154410 21075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:48.156240 21075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:48.157501 21075 hybrid_clock.cc:648] HybridClock initialized: now 1786474428157403 us; error 93 us; skew 500 ppm
I20260811 18:53:48.157935 21075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:48 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474428, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:48.166556 21075 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:53:48.168216 21075 webserver.cc:460] Webserver started at http://127.19.155.254:44759/ using document root <none> and password file <none>
I20260811 18:53:48.168916 21075 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:48.169072 21075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:48.169399 21075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:48.172423 21075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "8e0dca66b5e041c6af5ec6c568ac51d1"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "35d6d61a437d092335823b5ed99317fc"
server_key_iv: "945072da050ab325ff33aaa3f3e3402c"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.173188 21075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "8e0dca66b5e041c6af5ec6c568ac51d1"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "35d6d61a437d092335823b5ed99317fc"
server_key_iv: "945072da050ab325ff33aaa3f3e3402c"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.178463 21075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:53:48.182061 21108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:48.183482 21075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:48.183692 21075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "8e0dca66b5e041c6af5ec6c568ac51d1"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "35d6d61a437d092335823b5ed99317fc"
server_key_iv: "945072da050ab325ff33aaa3f3e3402c"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.183900 21075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:48.196214 21075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:48.200528 21075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:48.200811 21075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:48.223902 21075 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:35519
I20260811 18:53:48.223927 21194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:35519 every 8 connection(s)
I20260811 18:53:48.225380 21075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:48.229233 21195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:48.231103 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21075
I20260811 18:53:48.231357 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:53:48.232215 20079 external_mini_cluster.cc:1428] Setting key 1ffcfc30695723091fa81174f3b93dd6
I20260811 18:53:48.242328 21195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1: Bootstrap starting.
Aug 11 18:53:48 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:48.245290 21195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:48.246299 21195 log.cc:824] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:48.249178 21195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1: No bootstrap required, opened a new log
I20260811 18:53:48.253619 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:48.234327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52810 (local address 127.19.155.254:35519)
0811 18:53:48.235141 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:48.235155 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:48.235198 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:53:48.236729 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:48.236751 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:48.237111 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:48.237483 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:48.238982 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.240316 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.241536 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.242183 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.242390 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:48.246310 (+ 3920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:48.246322 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:48.246336 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:48.246372 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:48.249542 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:48.250256 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:48.250264 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:48.250270 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:48.250425 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:48.250815 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:48.250827 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:48.250830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:48.251390 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:48.251740 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:48.252276 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 18:53:48.252672 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":304,"threads_started":1}
I20260811 18:53:48.257747 21195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } }
I20260811 18:53:48.258160 21195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:48.258279 21195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e0dca66b5e041c6af5ec6c568ac51d1, State: Initialized, Role: FOLLOWER
I20260811 18:53:48.259018 21195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } }
I20260811 18:53:48.259286 21195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:48.259446 21195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:48.259634 21195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:48.261806 21195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } }
I20260811 18:53:48.262336 21195 leader_election.cc:302] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e0dca66b5e041c6af5ec6c568ac51d1; no voters:
I20260811 18:53:48.263162 21195 leader_election.cc:288] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:48.263432 21204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:48.264132 21204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [term 1 LEADER]: Becoming Leader. State: Replica: 8e0dca66b5e041c6af5ec6c568ac51d1, State: Running, Role: LEADER
I20260811 18:53:48.264621 21204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } }
I20260811 18:53:48.265206 21195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:48.267673 21208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e0dca66b5e041c6af5ec6c568ac51d1. Latest consensus state: current_term: 1 leader_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } } }
I20260811 18:53:48.268168 21208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:48.267704 21205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0dca66b5e041c6af5ec6c568ac51d1" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35519 } } }
I20260811 18:53:48.268748 21205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:48.270956 21219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:48.274853 21219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:48.283015 21219 catalog_manager.cc:1347] Generated new cluster ID: ce8218cd8c814d1f9745efdfd097151b
I20260811 18:53:48.283131 21219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:48.299263 21219 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:48.300551 21219 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:48.307768 21219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e0dca66b5e041c6af5ec6c568ac51d1: Generated new TSK 0
I20260811 18:53:48.308594 21219 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:53:48.360132 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:48.694519 21244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:48.694805 21244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:48.695000 21244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:48.702450 21244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:48.702555 21244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:48.702744 21244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:53:48.712865 21244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:48.714205 21244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:48.715606 21244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:48.728926 21261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:48.728998 21257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:48.729179 21256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:48.729915 21244 server_base.cc:1034] running on GCE node
I20260811 18:53:48.730463 21244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:48.731398 21244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:48.732597 21244 hybrid_clock.cc:648] HybridClock initialized: now 1786474428732551 us; error 41 us; skew 500 ppm
I20260811 18:53:48.732926 21244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:48 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474428, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:48.736147 21244 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:53:48.737582 21244 webserver.cc:460] Webserver started at http://127.19.155.193:35051/ using document root <none> and password file <none>
I20260811 18:53:48.738353 21244 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:48.738499 21244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:48.738817 21244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:48.741773 21244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "e58f1f373b99408fa3ef942457dd9916"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "bea1922693b4acddc322ce5d60522828"
server_key_iv: "5775e552e152e9d1ee7f0e0a7ec29b26"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.742573 21244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "e58f1f373b99408fa3ef942457dd9916"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "bea1922693b4acddc322ce5d60522828"
server_key_iv: "5775e552e152e9d1ee7f0e0a7ec29b26"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.748286 21244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 18:53:48.751775 21281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:48.753405 21244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:48.753595 21244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "e58f1f373b99408fa3ef942457dd9916"
format_stamp: "Formatted at 2026-08-11 18:53:48 on dist-test-slave-1nl6"
server_key: "bea1922693b4acddc322ce5d60522828"
server_key_iv: "5775e552e152e9d1ee7f0e0a7ec29b26"
server_key_version: "encryptionkey@0"
I20260811 18:53:48.753820 21244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:48.767364 21244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:48.771836 21244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:48.772083 21244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:48.772969 21244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:48.774214 21244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:48.774298 21244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:48.774381 21244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:48.774428 21244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:48.808720 21244 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36313
I20260811 18:53:48.808766 21482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36313 every 8 connection(s)
I20260811 18:53:48.810081 21244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:48.818944 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21244
I20260811 18:53:48.819206 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:48.820015 20079 external_mini_cluster.cc:1428] Setting key 948bb80cb99e86f7e908e4774a780202
Aug 11 18:53:48 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474428, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:48.832392 21486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:48.812971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:56941 (local address 127.19.155.254:35519)
0811 18:53:48.813415 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:48.813421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:48.814435 (+ 1014us) server_negotiation.cc:407] Connection header received
0811 18:53:48.816259 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:48.816264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:48.816330 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:48.816428 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:48.817839 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.818555 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.820912 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.821502 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.821631 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:48.825676 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:48.825686 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:48.825694 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:48.825738 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:48.829125 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:48.830057 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:48.830062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:48.830064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:48.830176 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:48.830676 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:48.830680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:48.830682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:48.830988 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:48.831108 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:48.831959 (+ 851us) server_negotiation.cc:299] Negotiation successful
0811 18:53:48.832118 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":323,"thread_start_us":210,"threads_started":1}
I20260811 18:53:48.833947 21487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:48.813563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35519 (local address 127.19.155.193:56941)
0811 18:53:48.814270 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:48.814317 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:48.816010 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:48.816630 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:48.816639 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:48.817122 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:48.817692 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:48.817710 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.818700 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.818706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:48.820743 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:48.820756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:48.821710 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:48.821715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:48.822016 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:48.822709 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:48.822739 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:48.825453 (+ 2714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:48.829274 (+ 3821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:48.829286 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:48.829305 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:48.829935 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:48.830286 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:48.830293 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:48.830300 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:48.830563 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:48.831110 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:48.831121 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:48.831566 (+ 445us) client_negotiation.cc:769] Sending connection context
0811 18:53:48.831864 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 18:53:48.832445 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":271,"threads_started":1}
I20260811 18:53:48.835561 21484 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35519
I20260811 18:53:48.835872 21484 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:48.836609 21484 heartbeater.cc:511] Master 127.19.155.254:35519 requested a full tablet report, sending...
I20260811 18:53:48.839092 21140 ts_manager.cc:194] Registered new tserver with Master: e58f1f373b99408fa3ef942457dd9916 (127.19.155.193:36313)
I20260811 18:53:48.841339 21140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:56941
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:53:48.868291 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:49.194516 21492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:49.194770 21492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:49.195022 21492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:49.202395 21492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:49.202500 21492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:49.202684 21492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:53:49.212154 21492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:49.213356 21492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:49.214643 21492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:49.227886 21500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:49.228075 21498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:49.228318 21505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:49.228655 21492 server_base.cc:1034] running on GCE node
I20260811 18:53:49.229252 21492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:49.230180 21492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:49.231421 21492 hybrid_clock.cc:648] HybridClock initialized: now 1786474429231369 us; error 44 us; skew 500 ppm
I20260811 18:53:49.231734 21492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:49 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474429, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:49.234988 21492 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:53:49.236455 21492 webserver.cc:460] Webserver started at http://127.19.155.194:38177/ using document root <none> and password file <none>
I20260811 18:53:49.237136 21492 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:49.237291 21492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:49.237609 21492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:49.240497 21492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "7d1d3e3e422e46ed9595c4eddf789697"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "16b302f06c9784a09f4cd1b931aec7db"
server_key_iv: "8d84a0689a90a58d4308793705a5d247"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.241288 21492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "7d1d3e3e422e46ed9595c4eddf789697"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "16b302f06c9784a09f4cd1b931aec7db"
server_key_iv: "8d84a0689a90a58d4308793705a5d247"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.246214 21492 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:53:49.249648 21517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.250835 21492 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:49.251049 21492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "7d1d3e3e422e46ed9595c4eddf789697"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "16b302f06c9784a09f4cd1b931aec7db"
server_key_iv: "8d84a0689a90a58d4308793705a5d247"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.251233 21492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:49.265913 21492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:49.270290 21492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:49.270591 21492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:49.271629 21492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:49.272960 21492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:49.273036 21492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.273212 21492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:49.273265 21492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.307224 21492 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:33443
I20260811 18:53:49.307262 21727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:33443 every 8 connection(s)
I20260811 18:53:49.308610 21492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:49.315924 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21492
I20260811 18:53:49.316128 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:49.316574 20079 external_mini_cluster.cc:1428] Setting key 3c9928da46bdae8ab566fb931b84edf1
Aug 11 18:53:49 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474429, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:49.328949 21486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.311256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:60127 (local address 127.19.155.254:35519)
0811 18:53:49.311446 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.311451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.312753 (+ 1302us) server_negotiation.cc:407] Connection header received
0811 18:53:49.314563 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.314568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.314633 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.314731 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:49.316374 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.317130 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.319075 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.319519 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.319656 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.323082 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:49.323087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:49.323091 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:49.323124 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:49.325804 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.326550 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.326563 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.326565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.326704 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.327222 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.327234 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.327236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.327494 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:49.327656 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.328351 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.328587 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:53:49.329895 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.311715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35519 (local address 127.19.155.194:60127)
0811 18:53:49.312574 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.312628 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.314330 (+ 1702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.315009 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.315017 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.315527 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:49.316156 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.316210 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.317299 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.317305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.318880 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.318893 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.319747 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.319755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.319998 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.320677 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:49.320701 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:49.322816 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:49.325952 (+ 3136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:49.325963 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:49.325979 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:49.326413 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:49.326823 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:49.326828 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:49.326832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:49.327097 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:49.327630 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:49.327637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:49.327978 (+ 341us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.328245 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.328774 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":372,"threads_started":1}
I20260811 18:53:49.331570 21728 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35519
I20260811 18:53:49.331903 21728 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:49.332763 21728 heartbeater.cc:511] Master 127.19.155.254:35519 requested a full tablet report, sending...
I20260811 18:53:49.334362 21140 ts_manager.cc:194] Registered new tserver with Master: 7d1d3e3e422e46ed9595c4eddf789697 (127.19.155.194:33443)
I20260811 18:53:49.335589 21140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:60127
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:53:49.362432 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:49.694034 21740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:49.694316 21740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:49.694416 21740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:49.701776 21740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:49.701889 21740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:49.702014 21740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:53:49.711855 21740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35519
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:49.713076 21740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:49.714344 21740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:49.727578 21746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:49.727613 21748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:49.728024 21750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:49.728468 21740 server_base.cc:1034] running on GCE node
I20260811 18:53:49.729061 21740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:49.729974 21740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:49.731179 21740 hybrid_clock.cc:648] HybridClock initialized: now 1786474429731134 us; error 40 us; skew 500 ppm
I20260811 18:53:49.731475 21740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:49 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474429, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:49.734401 21740 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:53:49.735868 21740 webserver.cc:460] Webserver started at http://127.19.155.195:42761/ using document root <none> and password file <none>
I20260811 18:53:49.736547 21740 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:49.736701 21740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:49.737023 21740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:49.739995 21740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "e79a586d396e4283a4e75809be235218"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "b7cfff2c07ed9947ca355554efbe8cad"
server_key_iv: "7bc7174dd0a89d7d45b37c3644ac3bec"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.740844 21740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "e79a586d396e4283a4e75809be235218"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "b7cfff2c07ed9947ca355554efbe8cad"
server_key_iv: "7bc7174dd0a89d7d45b37c3644ac3bec"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.745899 21740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:53:49.749560 21762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.750850 21740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:49.751048 21740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "e79a586d396e4283a4e75809be235218"
format_stamp: "Formatted at 2026-08-11 18:53:49 on dist-test-slave-1nl6"
server_key: "b7cfff2c07ed9947ca355554efbe8cad"
server_key_iv: "7bc7174dd0a89d7d45b37c3644ac3bec"
server_key_version: "encryptionkey@0"
I20260811 18:53:49.751247 21740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:49.765779 21740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:49.769768 21740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:49.770095 21740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:49.771260 21740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:49.772588 21740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:49.772661 21740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.772740 21740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:49.772789 21740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:49.806679 21740 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:44307
I20260811 18:53:49.806728 21981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:44307 every 8 connection(s)
I20260811 18:53:49.808024 21740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:49.811483 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21740
I20260811 18:53:49.811738 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:49.812345 20079 external_mini_cluster.cc:1428] Setting key 9de5d5062dc7b36de01f7f7ec594a687
Aug 11 18:53:49 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474429, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:49.828214 21486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.810686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:52283 (local address 127.19.155.254:35519)
0811 18:53:49.810933 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.810941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.812417 (+ 1476us) server_negotiation.cc:407] Connection header received
0811 18:53:49.814733 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.814739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.814852 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.814995 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:49.816478 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.817243 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.818689 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.819163 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.819262 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.822640 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:49.822645 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:49.822649 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:49.822681 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:49.825098 (+ 2417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.825745 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.825751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.825757 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.825919 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.826412 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.826418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.826426 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.826763 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:49.826955 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.827710 (+ 755us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.827921 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:53:49.829070 21985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.811245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35519 (local address 127.19.155.195:52283)
0811 18:53:49.812247 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.812292 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.814485 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.815270 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.815282 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.815783 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:49.816325 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.816342 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.817379 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.817383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.818558 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.818570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.819355 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.819360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.819546 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.820229 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:49.820252 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:49.822436 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:49.825234 (+ 2798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:49.825240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:49.825250 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:49.825626 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:49.826063 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:49.826071 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:49.826075 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:49.826276 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:49.826933 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:49.826941 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:49.827258 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.827567 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.828000 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":405,"threads_started":1}
I20260811 18:53:49.830427 21983 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35519
I20260811 18:53:49.830720 21983 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:49.831476 21983 heartbeater.cc:511] Master 127.19.155.254:35519 requested a full tablet report, sending...
I20260811 18:53:49.832871 21140 ts_manager.cc:194] Registered new tserver with Master: e79a586d396e4283a4e75809be235218 (127.19.155.195:44307)
I20260811 18:53:49.833652 21140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:52283
I20260811 18:53:49.840164 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:49.844414 21484 heartbeater.cc:503] Master 127.19.155.254:35519 was elected leader, sending a full tablet report...
I20260811 18:53:49.858801 21486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.846570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52820 (local address 127.19.155.254:35519)
0811 18:53:49.846744 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.846749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.847298 (+ 549us) server_negotiation.cc:407] Connection header received
0811 18:53:49.847425 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.847429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.847517 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.847596 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:49.849069 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.849805 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.851082 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.851498 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.851591 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.853819 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:49.853824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:49.853827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:49.853856 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:49.856501 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.857070 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.857075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.857077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.857219 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:49.857605 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:49.857608 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:49.857610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:49.857912 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:49.858112 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.858422 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.858572 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:53:49.864809 21140 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:49.872025 21140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:49.894927 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.885038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.19.155.194:33443)
0811 18:53:49.885933 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.885943 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.886698 (+ 755us) server_negotiation.cc:407] Connection header received
0811 18:53:49.886799 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.886805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.887026 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.887227 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:49.888251 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890050 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.892348 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.893741 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.893921 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.894094 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.894402 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.894559 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":753,"thread_start_us":581,"threads_started":1}
I20260811 18:53:49.895068 22007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.884413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33443 (local address 127.0.0.1:42108)
0811 18:53:49.886421 (+ 2008us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.886442 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.886570 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.887468 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.887476 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.887532 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:49.888023 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.888041 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890182 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.890187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.892189 (+ 2002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.892202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.893945 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.893951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.894141 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.894196 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.894335 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.894522 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1876,"mutex_wait_us":84,"spinlock_wait_cycles":19584,"thread_start_us":1716,"threads_started":1}
I20260811 18:53:49.895862 22008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.884484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48444 (local address 127.19.155.195:44307)
0811 18:53:49.885518 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.885529 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.886124 (+ 595us) server_negotiation.cc:407] Connection header received
0811 18:53:49.886617 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.886628 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.886878 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.887099 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:49.888609 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890220 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.892943 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.894373 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.894564 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.894723 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.895331 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.895500 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":842,"thread_start_us":675,"threads_started":1}
I20260811 18:53:49.895877 22003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.884080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44307 (local address 127.0.0.1:48444)
0811 18:53:49.885908 (+ 1828us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.885960 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.886329 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.887468 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.887478 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.887533 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:49.888369 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.888385 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890351 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.890362 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.892741 (+ 2379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.892758 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.894928 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.894938 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.895120 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.895152 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.895279 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.895420 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1574,"mutex_wait_us":373,"spinlock_wait_cycles":8064,"thread_start_us":1415,"threads_started":1}
I20260811 18:53:49.896493 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.887005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.19.155.193:36313)
0811 18:53:49.888054 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.888064 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.888091 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:53:49.888197 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.888203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.888384 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.888619 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:49.889213 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890824 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.893431 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.894846 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.895055 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.895230 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.895977 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.896160 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885,"thread_start_us":729,"threads_started":1}
I20260811 18:53:49.897060 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.886501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36313 (local address 127.0.0.1:33778)
0811 18:53:49.887499 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.887521 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.887736 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.888613 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.888617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.888641 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:49.888997 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.889006 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.890993 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.891000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.893231 (+ 2231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.893245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.895403 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.895408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.895579 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.895612 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.895706 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.895843 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"spinlock_wait_cycles":1920,"thread_start_us":681,"threads_started":1}
I20260811 18:53:49.899531 21855 tablet_service.cc:1467] Processing CreateTablet for tablet 67273927b9ac4072afb0b7cc76c5edb6 (DEFAULT_TABLE table=test-table [id=b27e6ed00e1a4098af9faeea76fcc2bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:49.899606 21602 tablet_service.cc:1467] Processing CreateTablet for tablet 67273927b9ac4072afb0b7cc76c5edb6 (DEFAULT_TABLE table=test-table [id=b27e6ed00e1a4098af9faeea76fcc2bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:49.900285 21363 tablet_service.cc:1467] Processing CreateTablet for tablet 67273927b9ac4072afb0b7cc76c5edb6 (DEFAULT_TABLE table=test-table [id=b27e6ed00e1a4098af9faeea76fcc2bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:49.900931 21855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67273927b9ac4072afb0b7cc76c5edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:49.901037 21602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67273927b9ac4072afb0b7cc76c5edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:49.901525 21363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67273927b9ac4072afb0b7cc76c5edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:49.912496 22015 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Bootstrap starting.
I20260811 18:53:49.916098 22017 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Bootstrap starting.
I20260811 18:53:49.916821 22015 tablet_bootstrap.cc:654] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:49.918213 22015 log.cc:824] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:49.919878 22017 tablet_bootstrap.cc:654] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:49.920312 22019 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Bootstrap starting.
I20260811 18:53:49.921159 22017 log.cc:824] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:49.921828 22015 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: No bootstrap required, opened a new log
I20260811 18:53:49.922147 22015 ts_tablet_manager.cc:1397] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:53:49.923380 22019 tablet_bootstrap.cc:654] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:49.924625 22019 log.cc:824] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:49.926852 22017 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: No bootstrap required, opened a new log
I20260811 18:53:49.927156 22017 ts_tablet_manager.cc:1397] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260811 18:53:49.927193 22019 tablet_bootstrap.cc:492] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: No bootstrap required, opened a new log
I20260811 18:53:49.927449 22019 ts_tablet_manager.cc:1397] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 18:53:49.932955 22015 raft_consensus.cc:348] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.933437 22015 raft_consensus.cc:374] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:49.933532 22015 raft_consensus.cc:729] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e79a586d396e4283a4e75809be235218, State: Initialized, Role: FOLLOWER
I20260811 18:53:49.934302 22015 consensus_queue.cc:260] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.935211 22019 raft_consensus.cc:348] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.935637 22019 raft_consensus.cc:374] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:49.935750 22019 raft_consensus.cc:729] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e58f1f373b99408fa3ef942457dd9916, State: Initialized, Role: FOLLOWER
I20260811 18:53:49.936442 22019 consensus_queue.cc:260] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.940795 22017 raft_consensus.cc:348] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.941196 21983 heartbeater.cc:503] Master 127.19.155.254:35519 was elected leader, sending a full tablet report...
I20260811 18:53:49.941242 22017 raft_consensus.cc:374] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:49.941365 22017 raft_consensus.cc:729] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1d3e3e422e46ed9595c4eddf789697, State: Initialized, Role: FOLLOWER
I20260811 18:53:49.941942 22015 ts_tablet_manager.cc:1428] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Time spent starting tablet: real 0.020s user 0.021s sys 0.000s
I20260811 18:53:49.942081 22017 consensus_queue.cc:260] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.943666 22019 ts_tablet_manager.cc:1428] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Time spent starting tablet: real 0.016s user 0.009s sys 0.005s
I20260811 18:53:49.944008 21728 heartbeater.cc:503] Master 127.19.155.254:35519 was elected leader, sending a full tablet report...
I20260811 18:53:49.945055 22017 ts_tablet_manager.cc:1428] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Time spent starting tablet: real 0.018s user 0.010s sys 0.005s
I20260811 18:53:49.945375 22025 raft_consensus.cc:482] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:49.945618 22025 raft_consensus.cc:504] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.947772 22025 leader_election.cc:288] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1d3e3e422e46ed9595c4eddf789697 (127.19.155.194:33443), e58f1f373b99408fa3ef942457dd9916 (127.19.155.193:36313)
I20260811 18:53:49.954558 21985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.948260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33443 (local address 127.19.155.195:40965)
0811 18:53:49.948607 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.948629 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.948743 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.949434 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.949446 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.949481 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:49.949763 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.949775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.951017 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.951021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.952716 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.952729 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.953814 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.953820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.954011 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.954036 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.954145 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.954275 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190}
I20260811 18:53:49.954593 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.948374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:40965 (local address 127.19.155.194:33443)
0811 18:53:49.949073 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.949079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.949098 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:53:49.949179 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.949184 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.949274 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.949399 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:49.949914 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.950874 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.952888 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.953655 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.953830 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.953905 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.954179 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.954323 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537}
I20260811 18:53:49.955404 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.949145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:42067 (local address 127.19.155.193:36313)
0811 18:53:49.949363 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.949371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.950014 (+ 643us) server_negotiation.cc:407] Connection header received
0811 18:53:49.950119 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.950124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.950197 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.950292 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:49.950764 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.951722 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.953581 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.954441 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.954615 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.954697 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:49.955086 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 18:53:49.955198 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:53:49.955576 22028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.948631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36313 (local address 127.19.155.195:42067)
0811 18:53:49.949906 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:49.949922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:49.950020 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:49.950310 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:49.950313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:49.950331 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:49.950623 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.950630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.951906 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.951910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.953419 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:49.953433 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.954653 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.954659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:49.954864 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.954897 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:53:49.955019 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 18:53:49.955177 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1128,"thread_start_us":918,"threads_started":1}
I20260811 18:53:49.955904 21637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67273927b9ac4072afb0b7cc76c5edb6" candidate_uuid: "e79a586d396e4283a4e75809be235218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1d3e3e422e46ed9595c4eddf789697" is_pre_election: true
I20260811 18:53:49.956490 21637 raft_consensus.cc:2454] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e79a586d396e4283a4e75809be235218 in term 0.
I20260811 18:53:49.956590 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67273927b9ac4072afb0b7cc76c5edb6" candidate_uuid: "e79a586d396e4283a4e75809be235218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e58f1f373b99408fa3ef942457dd9916" is_pre_election: true
I20260811 18:53:49.957204 21399 raft_consensus.cc:2454] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e79a586d396e4283a4e75809be235218 in term 0.
I20260811 18:53:49.957217 21768 leader_election.cc:302] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1d3e3e422e46ed9595c4eddf789697, e79a586d396e4283a4e75809be235218; no voters:
I20260811 18:53:49.957634 22025 raft_consensus.cc:2781] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:49.957856 22025 raft_consensus.cc:482] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:49.957989 22025 raft_consensus.cc:3037] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:49.960414 22025 raft_consensus.cc:504] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.961097 22025 leader_election.cc:288] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [CANDIDATE]: Term 1 election: Requested vote from peers 7d1d3e3e422e46ed9595c4eddf789697 (127.19.155.194:33443), e58f1f373b99408fa3ef942457dd9916 (127.19.155.193:36313)
I20260811 18:53:49.961464 21637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67273927b9ac4072afb0b7cc76c5edb6" candidate_uuid: "e79a586d396e4283a4e75809be235218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1d3e3e422e46ed9595c4eddf789697"
I20260811 18:53:49.961643 21637 raft_consensus.cc:3037] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:49.961607 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67273927b9ac4072afb0b7cc76c5edb6" candidate_uuid: "e79a586d396e4283a4e75809be235218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e58f1f373b99408fa3ef942457dd9916"
I20260811 18:53:49.961848 21399 raft_consensus.cc:3037] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:49.964031 21637 raft_consensus.cc:2454] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e79a586d396e4283a4e75809be235218 in term 1.
I20260811 18:53:49.964212 21399 raft_consensus.cc:2454] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e79a586d396e4283a4e75809be235218 in term 1.
I20260811 18:53:49.964462 21768 leader_election.cc:302] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1d3e3e422e46ed9595c4eddf789697, e79a586d396e4283a4e75809be235218; no voters:
I20260811 18:53:49.964804 22025 raft_consensus.cc:2781] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:49.965322 22025 raft_consensus.cc:686] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [term 1 LEADER]: Becoming Leader. State: Replica: e79a586d396e4283a4e75809be235218, State: Running, Role: LEADER
I20260811 18:53:49.965924 22025 consensus_queue.cc:237] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } }
I20260811 18:53:49.970984 21131 catalog_manager.cc:5495] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218 reported cstate change: term changed from 0 to 1, leader changed from <none> to e79a586d396e4283a4e75809be235218 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "e79a586d396e4283a4e75809be235218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e79a586d396e4283a4e75809be235218" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1d3e3e422e46ed9595c4eddf789697" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e58f1f373b99408fa3ef942457dd9916" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36313 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:53:49 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:50.004609 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:49.989965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.19.155.193:36313)
0811 18:53:49.990138 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:49.990142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:49.990673 (+ 531us) server_negotiation.cc:407] Connection header received
0811 18:53:49.990818 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:49.990822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:49.990938 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:49.991030 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:49.992537 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.993309 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.994586 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:49.995059 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:49.995171 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:49.999210 (+ 4039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:49.999225 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:49.999242 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:49.999273 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.002061 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.002687 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.002695 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.002697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.002829 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.003264 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.003267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.003269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.003634 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.003869 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.004070 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.004223 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:50.055830 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.041481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.19.155.193:36313)
0811 18:53:50.041705 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:50.041712 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:50.041906 (+ 194us) server_negotiation.cc:407] Connection header received
0811 18:53:50.042129 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:50.042133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:50.042238 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:50.042335 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:50.043837 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.044546 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.046245 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.046802 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.046971 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:50.050700 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:50.050705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:50.050709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:50.050749 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.053317 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.053866 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.053869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.053871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.054007 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.054471 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.054474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.054476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.054768 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.055065 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.055337 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.055500 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 18:53:50.059785 21984 tablet.cc:2369] T 67273927b9ac4072afb0b7cc76c5edb6 P e79a586d396e4283a4e75809be235218: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:50.060634 21729 tablet.cc:2369] T 67273927b9ac4072afb0b7cc76c5edb6 P 7d1d3e3e422e46ed9595c4eddf789697: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:50.063263 21485 tablet.cc:2369] T 67273927b9ac4072afb0b7cc76c5edb6 P e58f1f373b99408fa3ef942457dd9916: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:50.104507 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.091288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33808 (local address 127.19.155.193:36313)
0811 18:53:50.091536 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:50.091543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:50.091768 (+ 225us) server_negotiation.cc:407] Connection header received
0811 18:53:50.091925 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:50.091928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:50.091993 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:50.092079 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:50.093414 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.094091 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.095315 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.095744 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.095836 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:50.099627 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:50.099632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:50.099635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:50.099665 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.102104 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.102700 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.102704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.102706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.102826 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.103293 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.103302 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.103304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.103598 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.103783 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.104038 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.104211 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:53:50.106266 21330 tablet_service.cc:2908] Rejecting scan request for tablet 67273927b9ac4072afb0b7cc76c5edb6: Uninitialized: clean time has not yet been initialized
I20260811 18:53:50.109388 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21244
I20260811 18:53:50.121443 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.110281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33812 (local address 127.19.155.193:36313)
0811 18:53:50.110474 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:50.110479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:50.110867 (+ 388us) server_negotiation.cc:407] Connection header received
0811 18:53:50.111042 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:50.111045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:50.111112 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:50.111190 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:50.112378 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.113021 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.114136 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.114505 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.114596 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:50.116767 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:50.116772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:50.116775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:50.116802 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.119350 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.119938 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.119942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.119944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.120049 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.120388 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.120391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.120393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.120655 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.120869 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.121074 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.121228 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:53:50.122045 21475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:50.220242 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21244
I20260811 18:53:50.246116 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21492
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:53:50.260704 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.246873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42122 (local address 127.19.155.194:33443)
0811 18:53:50.247061 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:50.247065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:50.247084 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:53:50.247230 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:50.247234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:50.247297 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:50.247376 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:50.248527 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.249291 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.250505 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.250893 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.251181 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:50.255356 (+ 4175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:50.255370 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:50.255387 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:50.255423 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.258159 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.258756 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.258762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.258764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.258882 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.259374 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.259378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.259380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.259741 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.259977 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.260199 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.260360 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:53:50.261350 21723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:50.348379 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21492
I20260811 18:53:50.375062 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21740
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[21046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:53:50.389644 22008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.375830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48454 (local address 127.19.155.195:44307)
0811 18:53:50.376019 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:50.376027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:50.376047 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:53:50.376272 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:50.376276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:50.376364 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:50.376467 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:50.377710 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.378436 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.379895 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:50.380286 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:50.380432 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:50.384418 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:50.384433 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:50.384451 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:50.384489 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:50.387143 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.387730 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.387738 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.387740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.387938 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:50.388277 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:50.388280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:50.388282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:50.388647 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:50.388876 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:50.389202 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 18:53:50.389398 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:53:50.390287 21974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:50.480365 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:50.478833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36313 (local address 127.19.155.195:54429)
0811 18:53:50.479972 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:50.480105 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:36313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1031,"thread_start_us":848,"threads_started":1}
I20260811 18:53:50.480331 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21740
I20260811 18:53:50.502734 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21075
I20260811 18:53:50.504124 21186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:50.615475 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21075
2026-08-11T18:53:50Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4358 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[22074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[22074](info): set up 2 sockets
Aug 11 18:53:50 dist-test-slave-1nl6 krb5kdc[22074](info): commencing operation
krb5kdc: starting...
W20260811 18:53:51.921903 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:53:52 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:53:52.131386 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46761
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:52.449144 22095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:52.449478 22095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:52.449653 22095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:52.456619 22095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:52.456769 22095 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:53:52.456871 22095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:52.456990 22095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:52.457086 22095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:52.457176 22095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:52.466796 22095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46761
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:52.468145 22095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:52.469501 22095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:52.481578 22109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:52.481520 22115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:52.481613 22111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:52.482456 22095 server_base.cc:1034] running on GCE node
I20260811 18:53:52.483345 22095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:52.484668 22095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:52.485917 22095 hybrid_clock.cc:648] HybridClock initialized: now 1786474432485860 us; error 40 us; skew 500 ppm
I20260811 18:53:52.486253 22095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:52 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:52.489297 22095 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:53:52.490736 22095 webserver.cc:460] Webserver started at http://127.19.155.254:43097/ using document root <none> and password file <none>
I20260811 18:53:52.491477 22095 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:52.491611 22095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:52.491947 22095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:52.494817 22095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "6f31da11d0d44efdabfed5531e2497bc"
format_stamp: "Formatted at 2026-08-11 18:53:52 on dist-test-slave-1nl6"
server_key: "e8cb2e95b58f38992c401604acd33497"
server_key_iv: "a2b936ee119902ce2d033b09de7aa08a"
server_key_version: "encryptionkey@0"
I20260811 18:53:52.495657 22095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "6f31da11d0d44efdabfed5531e2497bc"
format_stamp: "Formatted at 2026-08-11 18:53:52 on dist-test-slave-1nl6"
server_key: "e8cb2e95b58f38992c401604acd33497"
server_key_iv: "a2b936ee119902ce2d033b09de7aa08a"
server_key_version: "encryptionkey@0"
I20260811 18:53:52.500736 22095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 18:53:52.504146 22126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:52.505420 22095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:52.505617 22095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "6f31da11d0d44efdabfed5531e2497bc"
format_stamp: "Formatted at 2026-08-11 18:53:52 on dist-test-slave-1nl6"
server_key: "e8cb2e95b58f38992c401604acd33497"
server_key_iv: "a2b936ee119902ce2d033b09de7aa08a"
server_key_version: "encryptionkey@0"
I20260811 18:53:52.505851 22095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:52.518338 22095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:52.522221 22095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:52.522490 22095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:52.544271 22095 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46761
I20260811 18:53:52.544289 22234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46761 every 8 connection(s)
I20260811 18:53:52.545616 22095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:52.548931 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22095
I20260811 18:53:52.549171 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:53:52.549741 22235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:52.550055 20079 external_mini_cluster.cc:1428] Setting key c2e104bf9fa512b3066a3c2e86f91ebd
I20260811 18:53:52.570349 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Bootstrap starting.
Aug 11 18:53:52 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:52.574347 22235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:52.575659 22235 log.cc:824] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:52.579206 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: No bootstrap required, opened a new log
I20260811 18:53:52.582861 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:52.552076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.19.155.254:46761)
0811 18:53:52.552894 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:52.552909 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:52.552953 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:53:52.554795 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:52.554818 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:52.555261 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:52.555591 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:52.557451 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:52.562577 (+ 5126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:52.565808 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:52.566970 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:52.567175 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:52.572812 (+ 5637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:52.572827 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:52.572854 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:52.572902 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:52.577793 (+ 4891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:52.578669 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:52.578680 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:52.578692 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:52.578990 (+ 298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:52.579465 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:52.579470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:52.579474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:52.580196 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:52.580503 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:52.581038 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 18:53:52.581498 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":379,"threads_started":1}
I20260811 18:53:52.588804 22235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } }
I20260811 18:53:52.589155 22235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:52.589280 22235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f31da11d0d44efdabfed5531e2497bc, State: Initialized, Role: FOLLOWER
I20260811 18:53:52.589875 22235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } }
I20260811 18:53:52.590124 22235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:52.590265 22235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:52.590454 22235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:52.593003 22235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } }
I20260811 18:53:52.593505 22235 leader_election.cc:302] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f31da11d0d44efdabfed5531e2497bc; no voters:
I20260811 18:53:52.594164 22235 leader_election.cc:288] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:52.594274 22245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:52.596918 22235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:52.601025 22245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [term 1 LEADER]: Becoming Leader. State: Replica: 6f31da11d0d44efdabfed5531e2497bc, State: Running, Role: LEADER
I20260811 18:53:52.601656 22245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } }
I20260811 18:53:52.607534 22249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f31da11d0d44efdabfed5531e2497bc. Latest consensus state: current_term: 1 leader_uuid: "6f31da11d0d44efdabfed5531e2497bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } } }
I20260811 18:53:52.608247 22249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:52.608052 22248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f31da11d0d44efdabfed5531e2497bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f31da11d0d44efdabfed5531e2497bc" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46761 } } }
I20260811 18:53:52.608357 22248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc [sys.catalog]: This master's current role is: LEADER
W20260811 18:53:52.620307 22271 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:52.620496 22271 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:52.623474 22260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:52.625846 22260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:52.636416 22260 catalog_manager.cc:1347] Generated new cluster ID: e9fa93813d2e44f88d38d94fe52a38b3
I20260811 18:53:52.636531 22260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:52.656879 22260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:52.658774 22260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:52.666446 22260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Generated new TSK 0
I20260811 18:53:52.667520 22260 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:53:52.732577 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46761
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:53.146272 22281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:53.146543 22281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:53.146739 22281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:53.153719 22281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:53.153827 22281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:53.153934 22281 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:53.154069 22281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:53:53.163295 22281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:46761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:53.164529 22281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:53.166038 22281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:53.179149 22287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:53.179190 22290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:53.179229 22288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:53.180042 22281 server_base.cc:1034] running on GCE node
I20260811 18:53:53.180642 22281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:53.181540 22281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:53.182755 22281 hybrid_clock.cc:648] HybridClock initialized: now 1786474433182670 us; error 55 us; skew 500 ppm
I20260811 18:53:53.183079 22281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:53 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:53.190416 22281 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:53:53.191855 22281 webserver.cc:460] Webserver started at http://127.19.155.193:36583/ using document root <none> and password file <none>
I20260811 18:53:53.192528 22281 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:53.192616 22281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:53.192898 22281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:53.195699 22281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "afaa7cb62316498bbf0516ff2ac04152"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "4a07bbc7976cbff5e820a0c63c00857b"
server_key_iv: "531c48c178f22820b5ce44620d8656a6"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.196573 22281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "afaa7cb62316498bbf0516ff2ac04152"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "4a07bbc7976cbff5e820a0c63c00857b"
server_key_iv: "531c48c178f22820b5ce44620d8656a6"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.201648 22281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:53:53.204870 22308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:53.206128 22281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:53.206318 22281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "afaa7cb62316498bbf0516ff2ac04152"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "4a07bbc7976cbff5e820a0c63c00857b"
server_key_iv: "531c48c178f22820b5ce44620d8656a6"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.206496 22281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:53.219048 22281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:53.223145 22281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:53.223378 22281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:53.225826 22281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:53.225956 22281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:53.226090 22281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:53.226166 22281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:53 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:53.249850 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.226553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:48189 (local address 127.19.155.254:46761)
0811 18:53:53.227279 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:53.227284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:53.228139 (+ 855us) server_negotiation.cc:407] Connection header received
0811 18:53:53.230080 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:53.230086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:53.230173 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:53.230313 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:53.232484 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.233813 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.236452 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.237023 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.237171 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.242362 (+ 5191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:53.242369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:53.242375 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:53.242420 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:53.246320 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.247354 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.247360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.247364 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.247560 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.248112 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.248117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.248121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.248400 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:53.248570 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:53.249249 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 18:53:53.249473 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":494,"threads_started":1}
I20260811 18:53:53.250823 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.227150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.193:48189)
0811 18:53:53.227969 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:53.228012 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:53.229791 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:53.230554 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:53.230561 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:53.231353 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:53.232172 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.232214 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.234062 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.234069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.236278 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.236291 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.237359 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.237367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.237562 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.238348 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:53.238373 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:53.242067 (+ 3694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:53.246488 (+ 4421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.246498 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.246518 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.247148 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.247700 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.247707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.247712 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.247971 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.248545 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:53.248552 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:53.248882 (+ 330us) client_negotiation.cc:769] Sending connection context
0811 18:53:53.249140 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 18:53:53.249646 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":370,"threads_started":1}
I20260811 18:53:53.269352 22281 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:46581
I20260811 18:53:53.269461 22517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:46581 every 8 connection(s)
I20260811 18:53:53.270776 22281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:53.275185 22521 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46761
I20260811 18:53:53.275825 22521 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:53.276558 22521 heartbeater.cc:511] Master 127.19.155.254:46761 requested a full tablet report, sending...
I20260811 18:53:53.277633 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22281
I20260811 18:53:53.277868 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:53.278553 20079 external_mini_cluster.cc:1428] Setting key 602d91edbd4695dfc20a8aec162aaf51
I20260811 18:53:53.279266 22151 ts_manager.cc:194] Registered new tserver with Master: afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581)
I20260811 18:53:53.281141 22151 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:48189
I20260811 18:53:53.285835 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.270804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:48133 (local address 127.19.155.254:46761)
0811 18:53:53.271023 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:53.271029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:53.271744 (+ 715us) server_negotiation.cc:407] Connection header received
0811 18:53:53.271957 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:53.271963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:53.272035 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:53.272153 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:53.273414 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.274878 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.276756 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.277181 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.277325 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.279668 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:53.279674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:53.279678 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:53.279712 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:53.283153 (+ 3441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.284031 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.284036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.284039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.284190 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.284601 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.284604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.284606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.284853 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:53.284965 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:53.285441 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 18:53:53.285599 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:53:53.286237 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.270770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.193:48133)
0811 18:53:53.271621 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:53.271639 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:53.271820 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:53.272182 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:53.272187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:53.272792 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:53.273185 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.273198 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.275046 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.275058 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.276600 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.276634 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.277366 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.277373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.277559 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.278237 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:53.278261 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:53.279234 (+ 973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:53.283304 (+ 4070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.283313 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.283320 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.283899 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.284314 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.284322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.284328 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.284492 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.284968 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:53.284975 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:53.285171 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 18:53:53.285354 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 18:53:53.285704 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":422,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:53:53.324239 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46761
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:53.653605 22530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:53.653877 22530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:53.654039 22530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:53.660807 22530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:53.660902 22530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:53.660990 22530 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:53.661073 22530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:53:53.670416 22530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:46761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:53.671629 22530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:53.673033 22530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:53.686271 22539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:53.686170 22540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:53.686216 22544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:53.686851 22530 server_base.cc:1034] running on GCE node
I20260811 18:53:53.687491 22530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:53.688349 22530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:53.689569 22530 hybrid_clock.cc:648] HybridClock initialized: now 1786474433689508 us; error 30 us; skew 500 ppm
I20260811 18:53:53.689823 22530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:53 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:53.692970 22530 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:53:53.694315 22530 webserver.cc:460] Webserver started at http://127.19.155.194:40695/ using document root <none> and password file <none>
I20260811 18:53:53.694976 22530 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:53.695072 22530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:53.695341 22530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:53.698756 22530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "0611f50ed3724842b0a01d6d77c03971"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "14aaf60fc90935cb14c161d192916c97"
server_key_iv: "44816f8adb4ed7b497b8bff754584fab"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.699532 22530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "0611f50ed3724842b0a01d6d77c03971"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "14aaf60fc90935cb14c161d192916c97"
server_key_iv: "44816f8adb4ed7b497b8bff754584fab"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.704421 22530 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 18:53:53.707777 22555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:53.708962 22530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:53.709092 22530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "0611f50ed3724842b0a01d6d77c03971"
format_stamp: "Formatted at 2026-08-11 18:53:53 on dist-test-slave-1nl6"
server_key: "14aaf60fc90935cb14c161d192916c97"
server_key_iv: "44816f8adb4ed7b497b8bff754584fab"
server_key_version: "encryptionkey@0"
I20260811 18:53:53.709271 22530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:53.722960 22530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:53.726583 22530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:53.726867 22530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:53.730235 22530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:53.730351 22530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:53.730509 22530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:53.730592 22530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:53 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:53.755918 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.731030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:56429 (local address 127.19.155.254:46761)
0811 18:53:53.731210 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:53.731216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:53.732661 (+ 1445us) server_negotiation.cc:407] Connection header received
0811 18:53:53.735781 (+ 3120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:53.735787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:53.735925 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:53.736066 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:53.738660 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.739708 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.743031 (+ 3323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.743629 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.743779 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.748820 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:53.748829 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:53.748836 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:53.748885 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:53.751949 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.752825 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.752833 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.752839 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.753034 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.753849 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.753855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.753859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.754151 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:53.754275 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:53.755452 (+ 1177us) server_negotiation.cc:299] Negotiation successful
0811 18:53:53.755672 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:53:53.758170 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.731518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.194:56429)
0811 18:53:53.732490 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:53.732544 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:53.735354 (+ 2810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:53.736380 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:53.736399 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:53.737428 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:53.738437 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.738471 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.739878 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.739883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.742816 (+ 2933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.742860 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.743921 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.743935 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.744312 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.745022 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:53.745059 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:53.748609 (+ 3550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:53.752096 (+ 3487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.752109 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.752141 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.752691 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.753185 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.753194 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.753201 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.753686 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.754300 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:53.754311 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:53.754876 (+ 565us) client_negotiation.cc:769] Sending connection context
0811 18:53:53.755298 (+ 422us) client_negotiation.cc:240] Negotiation successful
0811 18:53:53.755989 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":387,"threads_started":1}
I20260811 18:53:53.776005 22530 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44985
I20260811 18:53:53.776088 22775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44985 every 8 connection(s)
I20260811 18:53:53.777652 22530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:53.779791 22776 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46761
I20260811 18:53:53.780045 22776 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:53.780912 22776 heartbeater.cc:511] Master 127.19.155.254:46761 requested a full tablet report, sending...
I20260811 18:53:53.782509 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.765997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37429 (local address 127.19.155.254:46761)
0811 18:53:53.766183 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:53.766189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:53.767002 (+ 813us) server_negotiation.cc:407] Connection header received
0811 18:53:53.767308 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:53.767313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:53.767399 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:53.767465 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:53.768460 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.769682 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.772424 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.773117 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.773268 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.776158 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:53.776166 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:53.776170 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:53.776209 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:53.779600 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.780459 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.780465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.780470 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.780629 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:53.781015 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:53.781019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:53.781022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:53.781467 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:53.781627 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:53.782090 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 18:53:53.782286 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:53:53.782593 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:53.766088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.194:37429)
0811 18:53:53.766856 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:53.766882 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:53.767129 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:53.767612 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:53.767615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:53.768025 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:53.768312 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.768320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.769855 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.769863 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.772244 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:53.772263 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:53.773369 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:53.773378 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:53.773644 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:53.774534 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:53.774557 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:53.775908 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:53.779720 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.779725 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.779728 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.780319 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.780741 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:53.780744 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:53.780746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:53.780885 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:53.781587 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:53.781591 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:53.781770 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 18:53:53.781927 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 18:53:53.782185 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":465,"threads_started":1}
I20260811 18:53:53.782582 22151 ts_manager.cc:194] Registered new tserver with Master: 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985)
I20260811 18:53:53.783578 22151 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:56429
I20260811 18:53:53.783753 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22530
I20260811 18:53:53.783967 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:53.784569 20079 external_mini_cluster.cc:1428] Setting key 3e80dc25e3231fe13eeb4bfbb8bb46bd
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:53:53.827936 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46761
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:54.159655 22781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:54.159919 22781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:54.160081 22781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:54.167541 22781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:54.167646 22781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:54.167737 22781 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:54.167819 22781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:53:54.177175 22781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:46761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:54.178328 22781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:54.179569 22781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:54.192538 22789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:54.192632 22790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:54.192569 22793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:54.193670 22781 server_base.cc:1034] running on GCE node
I20260811 18:53:54.194351 22781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:54.195307 22781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:54.196552 22781 hybrid_clock.cc:648] HybridClock initialized: now 1786474434196474 us; error 54 us; skew 500 ppm
I20260811 18:53:54.196841 22781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:54 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:54.200090 22781 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:53:54.201578 22781 webserver.cc:460] Webserver started at http://127.19.155.195:41243/ using document root <none> and password file <none>
I20260811 18:53:54.202271 22781 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:54.202407 22781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:54.202740 22781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:54.205799 22781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "b2ccab3b11b446a7b7343e2279ae18b9"
format_stamp: "Formatted at 2026-08-11 18:53:54 on dist-test-slave-1nl6"
server_key: "0da53d2a0d202771777752bf715cc7a0"
server_key_iv: "4f8566a6151bf5f3cad957173ddc2180"
server_key_version: "encryptionkey@0"
I20260811 18:53:54.206632 22781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "b2ccab3b11b446a7b7343e2279ae18b9"
format_stamp: "Formatted at 2026-08-11 18:53:54 on dist-test-slave-1nl6"
server_key: "0da53d2a0d202771777752bf715cc7a0"
server_key_iv: "4f8566a6151bf5f3cad957173ddc2180"
server_key_version: "encryptionkey@0"
I20260811 18:53:54.212047 22781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 18:53:54.215623 22803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:54.216900 22781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:53:54.217074 22781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "b2ccab3b11b446a7b7343e2279ae18b9"
format_stamp: "Formatted at 2026-08-11 18:53:54 on dist-test-slave-1nl6"
server_key: "0da53d2a0d202771777752bf715cc7a0"
server_key_iv: "4f8566a6151bf5f3cad957173ddc2180"
server_key_version: "encryptionkey@0"
I20260811 18:53:54.217320 22781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:54.233520 22781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:54.237321 22781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:54.237591 22781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:54.240355 22781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:54.240513 22781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:54.240689 22781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:54.240825 22781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:54 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:54.262992 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.240657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59325 (local address 127.19.155.254:46761)
0811 18:53:54.240895 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.240904 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.242216 (+ 1312us) server_negotiation.cc:407] Connection header received
0811 18:53:54.244294 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.244300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.244391 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.244514 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:54.246673 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.248066 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.250614 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.251236 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.251390 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.256831 (+ 5441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:54.256837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:54.256840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:54.256874 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:54.259785 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.260552 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.260565 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.260567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.260694 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.261156 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.261161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.261164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.261480 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:54.261629 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.262375 (+ 746us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.262601 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:53:54.264113 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.241111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.195:59325)
0811 18:53:54.242018 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.242072 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.244011 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.244751 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.244759 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.245601 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:54.246425 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.246480 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.248266 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.248274 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.250431 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.250448 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.251570 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.251585 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.251948 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.252709 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:54.252762 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:54.256594 (+ 3832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:54.259936 (+ 3342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.259945 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.259961 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.260389 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.260828 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.260834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.260837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.261033 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.261622 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:54.261630 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:54.261977 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.262254 (+ 277us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.262812 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":410,"threads_started":1}
I20260811 18:53:54.284683 22521 heartbeater.cc:503] Master 127.19.155.254:46761 was elected leader, sending a full tablet report...
I20260811 18:53:54.293073 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.270491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:60705 (local address 127.19.155.254:46761)
0811 18:53:54.270710 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.270730 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.277474 (+ 6744us) server_negotiation.cc:407] Connection header received
0811 18:53:54.277708 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.277712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.277775 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.277895 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:54.279854 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.280880 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.282960 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.283614 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.283689 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.286853 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:54.286857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:54.286860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:54.286890 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:54.289937 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.291021 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.291026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.291031 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.291164 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.291594 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.291597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.291599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.291877 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:54.292068 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.292687 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.292853 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:53:54.293630 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.270483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.19.155.195:60705)
0811 18:53:54.277326 (+ 6843us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.277353 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.277538 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.277928 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.277933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.278682 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:54.279627 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.279648 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.281090 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.281097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.282730 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.282752 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.284018 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.284028 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.284308 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.285118 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:54.285152 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:54.286647 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:54.290077 (+ 3430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.290085 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.290092 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.290870 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.291286 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.291291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.291297 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.291469 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.292030 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:54.292039 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:54.292327 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.292538 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.292995 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6625,"thread_start_us":6463,"threads_started":1}
I20260811 18:53:54.304494 22781 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:45075
I20260811 18:53:54.304539 23025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:45075 every 8 connection(s)
I20260811 18:53:54.305786 22781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:54.306234 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22781
I20260811 18:53:54.306484 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:54.307145 20079 external_mini_cluster.cc:1428] Setting key 278f1700270a0d5b5d5d78955b76ed8a
I20260811 18:53:54.308498 23030 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46761
I20260811 18:53:54.308740 23030 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:54.309662 23030 heartbeater.cc:511] Master 127.19.155.254:46761 requested a full tablet report, sending...
I20260811 18:53:54.311254 22150 ts_manager.cc:194] Registered new tserver with Master: b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075)
I20260811 18:53:54.312172 22150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:59325
I20260811 18:53:54.322304 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:53:54 dist-test-slave-1nl6 krb5kdc[22074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:53:54 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:54.371789 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.358195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.19.155.254:46761)
0811 18:53:54.358459 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.358468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.358635 (+ 167us) server_negotiation.cc:407] Connection header received
0811 18:53:54.358784 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.358788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.358858 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.358997 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:54.360333 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.361134 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.362397 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.362792 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.362887 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.366642 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:54.366647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:54.366650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:54.366683 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:54.369404 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.369993 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.369997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.369999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.370125 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.370461 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.370465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.370467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.370731 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:54.370976 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.371223 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.371402 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 18:53:54.376138 22150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:54.382946 22150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:54.405691 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.394601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:45075 (local address 127.0.0.1:54046)
0811 18:53:54.395711 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.395760 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.395917 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.397380 (+ 1463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.397391 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.397444 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.397959 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.397974 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.400383 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.400389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.402758 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.402777 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.404745 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.404752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.404939 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.404997 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.405107 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.405269 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"thread_start_us":754,"threads_started":1}
I20260811 18:53:54.407290 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.394778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54046 (local address 127.19.155.195:45075)
0811 18:53:54.396621 (+ 1843us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.396630 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.396663 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:53:54.396809 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.396820 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.397094 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.398163 (+ 1069us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.398524 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.400196 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.402995 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.404530 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.406512 (+ 1982us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.406679 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.406746 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.406927 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1668,"thread_start_us":1553,"threads_started":1}
I20260811 18:53:54.409565 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.395525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53178 (local address 127.19.155.194:44985)
0811 18:53:54.397069 (+ 1544us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.397078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.397745 (+ 667us) server_negotiation.cc:407] Connection header received
0811 18:53:54.398097 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.398106 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.398330 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.398538 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.400534 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.402019 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.405568 (+ 3549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.406995 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.407171 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.407343 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.409069 (+ 1726us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.409235 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":558,"threads_started":1}
I20260811 18:53:54.410058 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.394888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44985 (local address 127.0.0.1:53178)
0811 18:53:54.397631 (+ 2743us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.397656 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.397873 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.398844 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.398848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.398878 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.400339 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.400356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.402209 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.402225 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.405378 (+ 3153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.405397 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.408566 (+ 3169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.408572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.408829 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.408876 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.409577 (+ 701us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.409740 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2565,"thread_start_us":2339,"threads_started":1}
I20260811 18:53:54.411952 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 105b446a06d543a9a959704b8742bdfc (DEFAULT_TABLE table=test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.413724 22885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 105b446a06d543a9a959704b8742bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.413908 22657 tablet_service.cc:1467] Processing CreateTablet for tablet 105b446a06d543a9a959704b8742bdfc (DEFAULT_TABLE table=test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.415284 22657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 105b446a06d543a9a959704b8742bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.416174 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.397303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46581 (local address 127.0.0.1:42042)
0811 18:53:54.406179 (+ 8876us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.406198 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.406284 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.409912 (+ 3628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.409918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.409946 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.410141 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.410155 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.412009 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.412014 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.413848 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.413864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.415398 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.415404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.415593 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.415633 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.415753 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.415895 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8788,"thread_start_us":11906,"threads_started":1}
I20260811 18:53:54.416232 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.397743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42042 (local address 127.19.155.193:46581)
0811 18:53:54.409293 (+ 11550us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.409313 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.409340 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:53:54.409445 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.409453 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.409685 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.410338 (+ 653us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.410560 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.411854 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.414029 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.415211 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.415418 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.415597 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.415798 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.415955 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11394,"thread_start_us":11258,"threads_started":1}
I20260811 18:53:54.419502 22395 tablet_service.cc:1467] Processing CreateTablet for tablet 105b446a06d543a9a959704b8742bdfc (DEFAULT_TABLE table=test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.420522 22395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 105b446a06d543a9a959704b8742bdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.428871 23072 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Bootstrap starting.
I20260811 18:53:54.430189 23073 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Bootstrap starting.
I20260811 18:53:54.432803 23072 tablet_bootstrap.cc:654] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.433116 23073 tablet_bootstrap.cc:654] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.433454 23076 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Bootstrap starting.
I20260811 18:53:54.434504 23073 log.cc:824] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:54.434811 23072 log.cc:824] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:54.436916 23076 tablet_bootstrap.cc:654] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.437762 23073 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: No bootstrap required, opened a new log
I20260811 18:53:54.437932 23076 log.cc:824] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:54.438036 23073 ts_tablet_manager.cc:1397] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 18:53:54.438099 23072 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: No bootstrap required, opened a new log
I20260811 18:53:54.438346 23072 ts_tablet_manager.cc:1397] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260811 18:53:54.440622 23076 tablet_bootstrap.cc:492] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: No bootstrap required, opened a new log
I20260811 18:53:54.440892 23076 ts_tablet_manager.cc:1397] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260811 18:53:54.448172 23076 raft_consensus.cc:348] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.448530 23076 raft_consensus.cc:374] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.448668 23076 raft_consensus.cc:729] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaa7cb62316498bbf0516ff2ac04152, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.449029 23073 raft_consensus.cc:348] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.449277 23076 consensus_queue.cc:260] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.449187 23072 raft_consensus.cc:348] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.449506 23073 raft_consensus.cc:374] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.449609 23072 raft_consensus.cc:374] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.449620 23073 raft_consensus.cc:729] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0611f50ed3724842b0a01d6d77c03971, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.449751 23072 raft_consensus.cc:729] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ccab3b11b446a7b7343e2279ae18b9, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.450371 23072 consensus_queue.cc:260] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.450410 23073 consensus_queue.cc:260] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.451056 23076 ts_tablet_manager.cc:1428] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Time spent starting tablet: real 0.010s user 0.006s sys 0.005s
I20260811 18:53:54.452026 22776 heartbeater.cc:503] Master 127.19.155.254:46761 was elected leader, sending a full tablet report...
I20260811 18:53:54.452513 23030 heartbeater.cc:503] Master 127.19.155.254:46761 was elected leader, sending a full tablet report...
I20260811 18:53:54.453627 23072 ts_tablet_manager.cc:1428] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Time spent starting tablet: real 0.015s user 0.005s sys 0.011s
I20260811 18:53:54.454427 23073 ts_tablet_manager.cc:1428] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Time spent starting tablet: real 0.016s user 0.014s sys 0.002s
W20260811 18:53:54.526804 22524 tablet.cc:2369] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:54.529968 22778 tablet.cc:2369] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:54.552902 23088 raft_consensus.cc:482] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:54.553231 23088 raft_consensus.cc:504] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.555075 23088 leader_election.cc:288] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985), afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581)
W20260811 18:53:54.557775 23032 tablet.cc:2369] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:54.562742 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.555549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44985 (local address 127.19.155.195:56075)
0811 18:53:54.555845 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.555866 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.556008 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.556628 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.556633 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.556668 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.556902 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.556912 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.558368 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.558373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.560596 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.560611 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.562097 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.562101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.562231 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.562257 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.562333 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.562428 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":47}
I20260811 18:53:54.562777 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.555639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:56075 (local address 127.19.155.194:44985)
0811 18:53:54.555848 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.555855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.556145 (+ 290us) server_negotiation.cc:407] Connection header received
0811 18:53:54.556231 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.556237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.556328 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.556420 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.557055 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.558069 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.560752 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.561955 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.562127 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.562205 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.562394 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.562536 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:53:54.563496 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.556207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:55739 (local address 127.19.155.193:46581)
0811 18:53:54.556390 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.556397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.556561 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:53:54.556886 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.556892 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.556978 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.557068 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.557871 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.558852 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.561190 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.562445 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.562594 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.562663 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.563092 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.563224 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:53:54.563921 22690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "105b446a06d543a9a959704b8742bdfc" candidate_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611f50ed3724842b0a01d6d77c03971" is_pre_election: true
I20260811 18:53:54.564263 23090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.555582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46581 (local address 127.19.155.195:55739)
0811 18:53:54.556452 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.556476 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.556720 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.557226 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.557231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.557257 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.557657 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.557669 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.559037 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.559044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.561050 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.561061 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.562677 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.562683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.562872 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.562932 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.563681 (+ 749us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.563826 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":25,"spinlock_wait_cycles":23296,"thread_start_us":822,"threads_started":1}
I20260811 18:53:54.564530 22690 raft_consensus.cc:2454] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ccab3b11b446a7b7343e2279ae18b9 in term 0.
I20260811 18:53:54.565357 22810 leader_election.cc:302] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0611f50ed3724842b0a01d6d77c03971, b2ccab3b11b446a7b7343e2279ae18b9; no voters:
I20260811 18:53:54.565464 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "105b446a06d543a9a959704b8742bdfc" candidate_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaa7cb62316498bbf0516ff2ac04152" is_pre_election: true
I20260811 18:53:54.565871 23088 raft_consensus.cc:2781] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:54.566074 23088 raft_consensus.cc:482] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:54.565994 22427 raft_consensus.cc:2454] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2ccab3b11b446a7b7343e2279ae18b9 in term 0.
I20260811 18:53:54.566201 23088 raft_consensus.cc:3037] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.568708 23088 raft_consensus.cc:504] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.569388 23088 leader_election.cc:288] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [CANDIDATE]: Term 1 election: Requested vote from peers 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985), afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581)
I20260811 18:53:54.569875 22690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "105b446a06d543a9a959704b8742bdfc" candidate_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611f50ed3724842b0a01d6d77c03971"
I20260811 18:53:54.569892 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "105b446a06d543a9a959704b8742bdfc" candidate_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaa7cb62316498bbf0516ff2ac04152"
I20260811 18:53:54.570075 22690 raft_consensus.cc:3037] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.570097 22427 raft_consensus.cc:3037] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.572438 22427 raft_consensus.cc:2454] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ccab3b11b446a7b7343e2279ae18b9 in term 1.
I20260811 18:53:54.572475 22690 raft_consensus.cc:2454] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2ccab3b11b446a7b7343e2279ae18b9 in term 1.
I20260811 18:53:54.572896 22806 leader_election.cc:302] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afaa7cb62316498bbf0516ff2ac04152, b2ccab3b11b446a7b7343e2279ae18b9; no voters:
I20260811 18:53:54.573222 23088 raft_consensus.cc:2781] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:54.573695 23088 raft_consensus.cc:686] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 LEADER]: Becoming Leader. State: Replica: b2ccab3b11b446a7b7343e2279ae18b9, State: Running, Role: LEADER
I20260811 18:53:54.574187 23088 consensus_queue.cc:237] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } }
I20260811 18:53:54.579237 22151 catalog_manager.cc:5495] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:54.602017 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.596746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54048 (local address 127.19.155.195:45075)
0811 18:53:54.596995 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.597001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.597020 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:53:54.597378 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.597383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.597460 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.597576 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:54.597892 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.598693 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.600019 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.600427 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.600520 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.600944 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:54.601419 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:54.601522 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.601637 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.601700 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:53:54.609922 22427 raft_consensus.cc:1261] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Refusing update from remote peer b2ccab3b11b446a7b7343e2279ae18b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:54.610004 22690 raft_consensus.cc:1261] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Refusing update from remote peer b2ccab3b11b446a7b7343e2279ae18b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:54.610935 23088 consensus_queue.cc:1035] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:54.611317 23091 consensus_queue.cc:1035] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:54.644876 22151 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:54.645143 22151 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:54.649991 22151 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Sending DeleteTablet for 3 replicas of tablet 105b446a06d543a9a959704b8742bdfc
I20260811 18:53:54.651158 22885 tablet_service.cc:1514] Processing DeleteTablet for tablet 105b446a06d543a9a959704b8742bdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:54 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:54046
I20260811 18:53:54.651214 22657 tablet_service.cc:1514] Processing DeleteTablet for tablet 105b446a06d543a9a959704b8742bdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:54 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53178
I20260811 18:53:54.652989 22395 tablet_service.cc:1514] Processing DeleteTablet for tablet 105b446a06d543a9a959704b8742bdfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:54 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:42042
I20260811 18:53:54.658012 22151 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:54.658826 22151 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:54.662176 23116 tablet_replica.cc:330] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: stopping tablet replica
I20260811 18:53:54.662715 23116 raft_consensus.cc:2229] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:54.663252 23116 raft_consensus.cc:2258] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:54.664204 23115 tablet_replica.cc:330] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: stopping tablet replica
I20260811 18:53:54.664664 23115 raft_consensus.cc:2229] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:54.665413 23115 raft_consensus.cc:2258] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:54.667858 23116 ts_tablet_manager.cc:1905] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:54.668643 23115 ts_tablet_manager.cc:1905] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:54.670570 22393 tablet_service.cc:1467] Processing CreateTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe (DEFAULT_TABLE table=test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.670610 22657 tablet_service.cc:1467] Processing CreateTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe (DEFAULT_TABLE table=test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.671092 22657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efcd58c58c234c2ba82b5d5e7f61dcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.671173 22393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efcd58c58c234c2ba82b5d5e7f61dcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.675676 22885 tablet_service.cc:1467] Processing CreateTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe (DEFAULT_TABLE table=test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:54.676147 22885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efcd58c58c234c2ba82b5d5e7f61dcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.677028 23115 ts_tablet_manager.cc:1918] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:54.677872 23076 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Bootstrap starting.
I20260811 18:53:54.679530 23076 tablet_bootstrap.cc:654] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.680385 23115 log.cc:1196] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/105b446a06d543a9a959704b8742bdfc
I20260811 18:53:54.681741 23115 ts_tablet_manager.cc:1939] T 105b446a06d543a9a959704b8742bdfc P b2ccab3b11b446a7b7343e2279ae18b9: Deleting consensus metadata
I20260811 18:53:54.683861 22131 catalog_manager.cc:4841] TS b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075): tablet 105b446a06d543a9a959704b8742bdfc (table test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]) successfully deleted
I20260811 18:53:54.684513 23073 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Bootstrap starting.
I20260811 18:53:54.686208 23073 tablet_bootstrap.cc:654] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.687484 23119 tablet_replica.cc:330] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: stopping tablet replica
I20260811 18:53:54.688073 23119 raft_consensus.cc:2229] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:54.688658 23119 raft_consensus.cc:2258] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:54.691022 23119 ts_tablet_manager.cc:1905] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:54.692606 23072 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Bootstrap starting.
I20260811 18:53:54.692782 23116 ts_tablet_manager.cc:1918] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:54.692996 23116 log.cc:1196] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/105b446a06d543a9a959704b8742bdfc
I20260811 18:53:54.693722 23116 ts_tablet_manager.cc:1939] T 105b446a06d543a9a959704b8742bdfc P 0611f50ed3724842b0a01d6d77c03971: Deleting consensus metadata
I20260811 18:53:54.694311 23072 tablet_bootstrap.cc:654] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.697504 23076 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: No bootstrap required, opened a new log
I20260811 18:53:54.697671 23076 ts_tablet_manager.cc:1397] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.003s
I20260811 18:53:54.698669 23076 raft_consensus.cc:348] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.698944 23076 raft_consensus.cc:374] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.699065 23076 raft_consensus.cc:729] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaa7cb62316498bbf0516ff2ac04152, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.699381 23119 ts_tablet_manager.cc:1918] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:54.699609 23119 log.cc:1196] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/105b446a06d543a9a959704b8742bdfc
I20260811 18:53:54.699685 23073 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: No bootstrap required, opened a new log
I20260811 18:53:54.699493 23076 consensus_queue.cc:260] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.699844 23073 ts_tablet_manager.cc:1397] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.010s
I20260811 18:53:54.700413 23119 ts_tablet_manager.cc:1939] T 105b446a06d543a9a959704b8742bdfc P afaa7cb62316498bbf0516ff2ac04152: Deleting consensus metadata
I20260811 18:53:54.700693 23073 raft_consensus.cc:348] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.700942 23073 raft_consensus.cc:374] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.701052 23073 raft_consensus.cc:729] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0611f50ed3724842b0a01d6d77c03971, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.701397 23073 consensus_queue.cc:260] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.702544 22130 catalog_manager.cc:4841] TS afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581): tablet 105b446a06d543a9a959704b8742bdfc (table test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]) successfully deleted
I20260811 18:53:54.702618 23076 ts_tablet_manager.cc:1428] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 18:53:54.702889 23073 ts_tablet_manager.cc:1428] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:54.703910 23072 tablet_bootstrap.cc:492] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: No bootstrap required, opened a new log
I20260811 18:53:54.703994 22132 catalog_manager.cc:4841] TS 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985): tablet 105b446a06d543a9a959704b8742bdfc (table test-table [id=d7a570abe04d4eb484dfdc9e51dfd99e]) successfully deleted
I20260811 18:53:54.704668 23072 ts_tablet_manager.cc:1397] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260811 18:53:54.706235 23072 raft_consensus.cc:348] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.706476 23072 raft_consensus.cc:374] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.706571 23072 raft_consensus.cc:729] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ccab3b11b446a7b7343e2279ae18b9, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.706861 23072 consensus_queue.cc:260] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.707533 23072 ts_tablet_manager.cc:1428] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:54.824165 23085 raft_consensus.cc:482] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:54.824448 23085 raft_consensus.cc:504] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.826121 23085 leader_election.cc:288] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581), b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075)
I20260811 18:53:54.834223 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.826803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:44075 (local address 127.19.155.193:46581)
0811 18:53:54.827014 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.827022 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.827661 (+ 639us) server_negotiation.cc:407] Connection header received
0811 18:53:54.827972 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.827977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.828058 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.828138 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.829178 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.830312 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.832356 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.833161 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.833353 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.833449 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.833779 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.833919 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:53:54.834482 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.826405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46581 (local address 127.19.155.194:44075)
0811 18:53:54.827556 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.827575 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.827792 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.828387 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.828394 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.828425 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.828955 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.828970 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.830462 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.830467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.832195 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.832209 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.833422 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.833428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.833569 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.833624 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.833732 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.833862 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":12,"thread_start_us":2296,"threads_started":1}
I20260811 18:53:54.835163 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efcd58c58c234c2ba82b5d5e7f61dcbe" candidate_uuid: "0611f50ed3724842b0a01d6d77c03971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaa7cb62316498bbf0516ff2ac04152" is_pre_election: true
I20260811 18:53:54.835438 22427 raft_consensus.cc:2454] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0611f50ed3724842b0a01d6d77c03971 in term 0.
I20260811 18:53:54.835999 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.826585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:45075 (local address 127.19.155.194:49265)
0811 18:53:54.829071 (+ 2486us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.829092 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.829212 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.829527 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.829531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.829553 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:54.829863 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.829871 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.831212 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.831218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.833507 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.833524 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.835254 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.835261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.835430 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.835452 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.835552 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.835678 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2350,"thread_start_us":855,"threads_started":1}
I20260811 18:53:54.836004 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.827204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:49265 (local address 127.19.155.195:45075)
0811 18:53:54.827411 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.827417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.829192 (+ 1775us) server_negotiation.cc:407] Connection header received
0811 18:53:54.829355 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.829359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.829421 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.829515 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:54.830005 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.831057 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.833699 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.835037 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.835227 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.835304 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.835578 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.835705 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:53:54.836067 22557 leader_election.cc:302] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0611f50ed3724842b0a01d6d77c03971, afaa7cb62316498bbf0516ff2ac04152; no voters:
I20260811 18:53:54.836529 23085 raft_consensus.cc:2781] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:54.836660 23085 raft_consensus.cc:482] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:54.836786 23085 raft_consensus.cc:3037] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.836890 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efcd58c58c234c2ba82b5d5e7f61dcbe" candidate_uuid: "0611f50ed3724842b0a01d6d77c03971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" is_pre_election: true
I20260811 18:53:54.837288 22933 raft_consensus.cc:2454] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0611f50ed3724842b0a01d6d77c03971 in term 0.
I20260811 18:53:54.840046 23085 raft_consensus.cc:504] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.840801 23085 leader_election.cc:288] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [CANDIDATE]: Term 1 election: Requested vote from peers afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581), b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075)
I20260811 18:53:54.841161 22427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efcd58c58c234c2ba82b5d5e7f61dcbe" candidate_uuid: "0611f50ed3724842b0a01d6d77c03971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afaa7cb62316498bbf0516ff2ac04152"
I20260811 18:53:54.841361 22427 raft_consensus.cc:3037] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.841351 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efcd58c58c234c2ba82b5d5e7f61dcbe" candidate_uuid: "0611f50ed3724842b0a01d6d77c03971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ccab3b11b446a7b7343e2279ae18b9"
I20260811 18:53:54.841583 22933 raft_consensus.cc:3037] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:54.843895 22933 raft_consensus.cc:2454] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0611f50ed3724842b0a01d6d77c03971 in term 1.
I20260811 18:53:54.844333 22558 leader_election.cc:302] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0611f50ed3724842b0a01d6d77c03971, b2ccab3b11b446a7b7343e2279ae18b9; no voters:
I20260811 18:53:54.844448 22427 raft_consensus.cc:2454] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0611f50ed3724842b0a01d6d77c03971 in term 1.
I20260811 18:53:54.844677 23085 raft_consensus.cc:2781] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:54.845259 23085 raft_consensus.cc:686] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 1 LEADER]: Becoming Leader. State: Replica: 0611f50ed3724842b0a01d6d77c03971, State: Running, Role: LEADER
I20260811 18:53:54.845670 23085 consensus_queue.cc:237] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.849180 22151 catalog_manager.cc:5495] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "0611f50ed3724842b0a01d6d77c03971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:53:54 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474432, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:54.918843 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.901334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46761 (local address 127.0.0.1:33326)
0811 18:53:54.902210 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:54.902232 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:54.902389 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:54.902892 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:54.902914 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:54.903901 (+ 987us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:54.904248 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.904264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.905370 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.905377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.906886 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:54.906933 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.907716 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.907726 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:54.907927 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.908710 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:54.908732 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:54.911972 (+ 3240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:54.916188 (+ 4216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.916201 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.916207 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.916719 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.917151 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:54.917155 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:54.917157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:54.917293 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:54.917959 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:54.917965 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:54.918154 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 18:53:54.918301 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 18:53:54.918520 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":442,"threads_started":1}
I20260811 18:53:54.919195 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:54.901498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33326 (local address 127.19.155.254:46761)
0811 18:53:54.902598 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:54.902602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:54.902623 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:53:54.902668 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:54.902671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:54.902724 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:54.902824 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:54.904418 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.905214 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.907069 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:54.907469 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:54.907561 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:54.912214 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:54.912221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:54.912225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:54.912265 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:54.916010 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.916862 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.916869 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.916873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.917034 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:54.917411 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:54.917419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:54.917423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:54.917789 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:54.917944 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:54.918459 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 18:53:54.918732 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1006,"thread_start_us":874,"threads_started":1}
I20260811 18:53:54.925107 22151 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:33326:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:53:54.926182 22151 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:54.933223 22395 tablet_service.cc:1467] Processing CreateTablet for tablet e69179e7a97d4308b761dfab7bc8f26c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=16c94daabf954593ae77a7106aacd1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:54.933477 22657 tablet_service.cc:1467] Processing CreateTablet for tablet e69179e7a97d4308b761dfab7bc8f26c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=16c94daabf954593ae77a7106aacd1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:54.933871 22395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69179e7a97d4308b761dfab7bc8f26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.934084 22657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69179e7a97d4308b761dfab7bc8f26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.934895 22885 tablet_service.cc:1467] Processing CreateTablet for tablet e69179e7a97d4308b761dfab7bc8f26c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=16c94daabf954593ae77a7106aacd1b2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:54.935495 22885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e69179e7a97d4308b761dfab7bc8f26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:54.942327 23076 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: Bootstrap starting.
I20260811 18:53:54.942783 23072 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: Bootstrap starting.
I20260811 18:53:54.944275 23076 tablet_bootstrap.cc:654] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.944734 23072 tablet_bootstrap.cc:654] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.945128 23073 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: Bootstrap starting.
I20260811 18:53:54.946965 23073 tablet_bootstrap.cc:654] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:54.955713 23072 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: No bootstrap required, opened a new log
I20260811 18:53:54.955904 23072 ts_tablet_manager.cc:1397] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260811 18:53:54.956674 23072 raft_consensus.cc:348] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.956900 23072 raft_consensus.cc:374] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.956986 23072 raft_consensus.cc:729] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ccab3b11b446a7b7343e2279ae18b9, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.957249 23072 consensus_queue.cc:260] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.957712 23088 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:54.957973 23088 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:54.958678 23072 ts_tablet_manager.cc:1428] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 18:53:54.960515 23076 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: No bootstrap required, opened a new log
I20260811 18:53:54.960609 23073 tablet_bootstrap.cc:492] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: No bootstrap required, opened a new log
I20260811 18:53:54.960700 23076 ts_tablet_manager.cc:1397] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20260811 18:53:54.960805 23073 ts_tablet_manager.cc:1397] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.001s
I20260811 18:53:54.961483 23076 raft_consensus.cc:348] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.961743 23076 raft_consensus.cc:374] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.961642 23073 raft_consensus.cc:348] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.961843 23076 raft_consensus.cc:729] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaa7cb62316498bbf0516ff2ac04152, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.961920 23073 raft_consensus.cc:374] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:54.962016 23073 raft_consensus.cc:729] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0611f50ed3724842b0a01d6d77c03971, State: Initialized, Role: FOLLOWER
I20260811 18:53:54.962157 23076 consensus_queue.cc:260] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.962666 23084 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:54.963127 23084 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:54.962311 23073 consensus_queue.cc:260] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:54.963580 23076 ts_tablet_manager.cc:1428] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:54.963701 23085 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:54.963982 23085 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:54.966279 23073 ts_tablet_manager.cc:1428] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260811 18:53:55.010543 23084 raft_consensus.cc:482] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:55.010874 23084 raft_consensus.cc:504] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:55.013187 23084 leader_election.cc:288] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985), b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075)
I20260811 18:53:55.022208 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.013986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57643 (local address 127.19.155.194:44985)
0811 18:53:55.014217 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.014228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.015264 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 18:53:55.015572 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.015579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.015663 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.015743 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:55.016564 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.017635 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.020079 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.021038 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.021241 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.021322 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.021740 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.021893 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:53:55.022316 23151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.013890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44985 (local address 127.19.155.193:57643)
0811 18:53:55.015147 (+ 1257us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:55.015166 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:55.015381 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:55.015960 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:55.015967 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:55.015993 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:55.016376 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.016390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.017796 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.017803 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.019936 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.019946 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.021262 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.021269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.021476 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.021578 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 18:53:55.021682 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:53:55.021891 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1128,"mutex_wait_us":1,"thread_start_us":560,"threads_started":1}
I20260811 18:53:55.022339 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.013767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:36773 (local address 127.19.155.195:45075)
0811 18:53:55.014285 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.014293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.015042 (+ 749us) server_negotiation.cc:407] Connection header received
0811 18:53:55.015289 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.015295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.015384 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.015482 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:55.016039 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.017127 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.019891 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.021324 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.021496 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.021573 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.021894 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.022045 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367}
I20260811 18:53:55.023082 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.013515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:45075 (local address 127.19.155.193:36773)
0811 18:53:55.014918 (+ 1403us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:55.014942 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:55.015108 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:55.015507 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:55.015512 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:55.015539 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:55.015862 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.015872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.017300 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.017305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.019713 (+ 2408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.019728 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.021533 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.021538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.021715 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.021745 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 18:53:55.022563 (+ 818us) client_negotiation.cc:240] Negotiation successful
0811 18:53:55.022662 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1186,"mutex_wait_us":29,"thread_start_us":1301,"threads_started":1}
I20260811 18:53:55.023365 22690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69179e7a97d4308b761dfab7bc8f26c" candidate_uuid: "afaa7cb62316498bbf0516ff2ac04152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611f50ed3724842b0a01d6d77c03971" is_pre_election: true
I20260811 18:53:55.023639 22690 raft_consensus.cc:2454] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afaa7cb62316498bbf0516ff2ac04152 in term 0.
I20260811 18:53:55.023685 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69179e7a97d4308b761dfab7bc8f26c" candidate_uuid: "afaa7cb62316498bbf0516ff2ac04152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" is_pre_election: true
I20260811 18:53:55.023937 22933 raft_consensus.cc:2454] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afaa7cb62316498bbf0516ff2ac04152 in term 0.
I20260811 18:53:55.024248 22317 leader_election.cc:302] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0611f50ed3724842b0a01d6d77c03971, afaa7cb62316498bbf0516ff2ac04152; no voters:
I20260811 18:53:55.024735 23084 raft_consensus.cc:2781] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:55.024888 23084 raft_consensus.cc:482] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:55.025010 23084 raft_consensus.cc:3037] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:55.028455 23084 raft_consensus.cc:504] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:55.029182 23084 leader_election.cc:288] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [CANDIDATE]: Term 1 election: Requested vote from peers 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985), b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075)
I20260811 18:53:55.029625 22690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69179e7a97d4308b761dfab7bc8f26c" candidate_uuid: "afaa7cb62316498bbf0516ff2ac04152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0611f50ed3724842b0a01d6d77c03971"
I20260811 18:53:55.029675 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e69179e7a97d4308b761dfab7bc8f26c" candidate_uuid: "afaa7cb62316498bbf0516ff2ac04152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2ccab3b11b446a7b7343e2279ae18b9"
I20260811 18:53:55.029881 22690 raft_consensus.cc:3037] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:55.029906 22933 raft_consensus.cc:3037] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:55.032989 22690 raft_consensus.cc:2454] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afaa7cb62316498bbf0516ff2ac04152 in term 1.
I20260811 18:53:55.033205 22933 raft_consensus.cc:2454] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afaa7cb62316498bbf0516ff2ac04152 in term 1.
I20260811 18:53:55.033412 22317 leader_election.cc:302] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0611f50ed3724842b0a01d6d77c03971, afaa7cb62316498bbf0516ff2ac04152; no voters:
I20260811 18:53:55.033720 23084 raft_consensus.cc:2781] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:55.034258 23084 raft_consensus.cc:686] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [term 1 LEADER]: Becoming Leader. State: Replica: afaa7cb62316498bbf0516ff2ac04152, State: Running, Role: LEADER
I20260811 18:53:55.034693 23084 consensus_queue.cc:237] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } }
I20260811 18:53:55.036859 23157 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: TxnStatusTablet state changed. Reason: New leader afaa7cb62316498bbf0516ff2ac04152. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.037568 23157 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:55.038828 22151 catalog_manager.cc:5495] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 reported cstate change: term changed from 0 to 1, leader changed from <none> to afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:55.043381 23162 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:53:55.043645 23162 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:53:55.079834 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.072466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42056 (local address 127.19.155.193:46581)
0811 18:53:55.072655 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.072662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.072680 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:53:55.072781 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.072788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.072909 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.073068 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:55.073541 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.074792 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.076865 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.077597 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.077759 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.078346 (+ 587us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.079121 (+ 775us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.079262 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.079418 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.079507 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:53:55.079878 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.071856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46581 (local address 127.0.0.1:42056)
0811 18:53:55.072124 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:55.072160 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:55.072317 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:55.073121 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:55.073128 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:55.073142 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:55.073372 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.073385 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.074996 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.075002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.076668 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.076698 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.077811 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.077818 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.078019 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.078108 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.079259 (+ 1151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.079285 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:53:55.079379 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:53:55.079540 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 18:53:55.085561 22690 raft_consensus.cc:1261] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Refusing update from remote peer afaa7cb62316498bbf0516ff2ac04152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:55.085698 22933 raft_consensus.cc:1261] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Refusing update from remote peer afaa7cb62316498bbf0516ff2ac04152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:55.086352 23084 consensus_queue.cc:1035] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:55.086675 23157 consensus_queue.cc:1035] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:55.100834 23088 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: TxnStatusTablet state changed. Reason: New leader afaa7cb62316498bbf0516ff2ac04152. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.101145 23088 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:55.102941 23157 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.103183 23157 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:55.103505 23101 mvcc.cc:205] Tried to move back new op lower bound from 7317399286101839872 to 7317399285905874944. Current Snapshot: MvccSnapshot[applied={T|T < 7317399286101839872 or (T in {7317399286101839872})}]
I20260811 18:53:55.105666 23085 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: TxnStatusTablet state changed. Reason: New leader afaa7cb62316498bbf0516ff2ac04152. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.105731 23088 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.105966 23085 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:55.106001 23088 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P b2ccab3b11b446a7b7343e2279ae18b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:55.110383 23084 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.110666 23084 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P afaa7cb62316498bbf0516ff2ac04152: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:55.111958 23098 mvcc.cc:205] Tried to move back new op lower bound from 7317399286101839872 to 7317399285905874944. Current Snapshot: MvccSnapshot[applied={T|T < 7317399286101839872}]
I20260811 18:53:55.113981 23085 tablet_replica.cc:439] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afaa7cb62316498bbf0516ff2ac04152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 } } peers { permanent_uuid: "0611f50ed3724842b0a01d6d77c03971" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44985 } } peers { permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 } } }
I20260811 18:53:55.114250 23085 tablet_replica.cc:442] T e69179e7a97d4308b761dfab7bc8f26c P 0611f50ed3724842b0a01d6d77c03971: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:55.132346 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.124411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.19.155.194:44985)
0811 18:53:55.124582 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.124589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.124726 (+ 137us) server_negotiation.cc:407] Connection header received
0811 18:53:55.125054 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.125061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.125181 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.125345 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:55.125963 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.127158 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.129393 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.130066 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.130198 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.130703 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.131463 (+ 760us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.131613 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.131746 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.131839 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:53:55.153858 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.146252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:59857 (local address 127.19.155.193:46581)
0811 18:53:55.146470 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.146477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.147254 (+ 777us) server_negotiation.cc:407] Connection header received
0811 18:53:55.147434 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.147440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.147531 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.147625 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:55.148207 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.149345 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.151499 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.152268 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.152392 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.152965 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.153092 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.153192 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.153348 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.153429 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:53:55.153904 23187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.146288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46581 (local address 127.19.155.194:59857)
0811 18:53:55.147130 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:55.147151 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:55.147301 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:55.147677 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:55.147684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:55.147700 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:55.148049 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.148061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.149503 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.149509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.151346 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.151362 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.152457 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.152465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.152675 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.152749 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.153210 (+ 461us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.153222 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:53:55.153315 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:53:55.153464 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":467,"threads_started":1}
I20260811 18:53:55.167397 22933 raft_consensus.cc:1261] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Refusing update from remote peer 0611f50ed3724842b0a01d6d77c03971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:55.167500 22427 raft_consensus.cc:1261] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Refusing update from remote peer 0611f50ed3724842b0a01d6d77c03971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:55.168084 23133 consensus_queue.cc:1035] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2ccab3b11b446a7b7343e2279ae18b9" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:55.168460 23085 consensus_queue.cc:1035] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afaa7cb62316498bbf0516ff2ac04152" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:55.213179 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.206061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57365 (local address 127.19.155.194:44985)
0811 18:53:55.206262 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.206270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.206320 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:53:55.206559 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.206564 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.206646 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.206706 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:55.207438 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.208549 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.210749 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.211574 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.211722 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.212278 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.212413 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.212503 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.212730 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.212837 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:53:55.214252 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.205568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44985 (local address 127.19.155.193:57365)
0811 18:53:55.206178 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:55.206199 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:55.206376 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:55.206845 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:55.206848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:55.206857 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:55.207269 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.207278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.208829 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.208840 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.210610 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:55.210623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.211783 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.211792 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:55.211962 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.212047 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:55.212563 (+ 516us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:55.212581 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 18:53:55.213599 (+ 1018us) client_negotiation.cc:240] Negotiation successful
0811 18:53:55.213775 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":863,"threads_started":1}
I20260811 18:53:55.260960 22149 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:55.261272 22149 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:55.264982 22149 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f31da11d0d44efdabfed5531e2497bc: Sending DeleteTablet for 3 replicas of tablet efcd58c58c234c2ba82b5d5e7f61dcbe
I20260811 18:53:55.265781 22395 tablet_service.cc:1514] Processing DeleteTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:55 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:42042
I20260811 18:53:55.266194 22885 tablet_service.cc:1514] Processing DeleteTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:55 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:54046
I20260811 18:53:55.266868 22657 tablet_service.cc:1514] Processing DeleteTablet for tablet efcd58c58c234c2ba82b5d5e7f61dcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:55 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53178
I20260811 18:53:55.276144 23198 tablet_replica.cc:330] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: stopping tablet replica
I20260811 18:53:55.276469 23198 raft_consensus.cc:2229] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:55.276835 23198 raft_consensus.cc:2258] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:55.278024 23198 ts_tablet_manager.cc:1905] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:55.285511 23198 ts_tablet_manager.cc:1918] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:55.285748 23198 log.cc:1196] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/efcd58c58c234c2ba82b5d5e7f61dcbe
I20260811 18:53:55.286319 23198 ts_tablet_manager.cc:1939] T efcd58c58c234c2ba82b5d5e7f61dcbe P afaa7cb62316498bbf0516ff2ac04152: Deleting consensus metadata
I20260811 18:53:55.287541 22130 catalog_manager.cc:4841] TS afaa7cb62316498bbf0516ff2ac04152 (127.19.155.193:46581): tablet efcd58c58c234c2ba82b5d5e7f61dcbe (table test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]) successfully deleted
I20260811 18:53:55.305013 23200 tablet_replica.cc:330] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: stopping tablet replica
I20260811 18:53:55.305262 23200 raft_consensus.cc:2229] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:55.305915 23200 raft_consensus.cc:2258] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:55.306543 23199 tablet_replica.cc:330] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: stopping tablet replica
I20260811 18:53:55.306777 23199 raft_consensus.cc:2229] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:55.307133 23199 raft_consensus.cc:2258] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:55.308477 23200 ts_tablet_manager.cc:1905] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:55.310281 23199 ts_tablet_manager.cc:1905] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:55.326952 23200 ts_tablet_manager.cc:1918] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:55.327136 23200 log.cc:1196] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/efcd58c58c234c2ba82b5d5e7f61dcbe
I20260811 18:53:55.327705 23200 ts_tablet_manager.cc:1939] T efcd58c58c234c2ba82b5d5e7f61dcbe P 0611f50ed3724842b0a01d6d77c03971: Deleting consensus metadata
I20260811 18:53:55.329017 22132 catalog_manager.cc:4841] TS 0611f50ed3724842b0a01d6d77c03971 (127.19.155.194:44985): tablet efcd58c58c234c2ba82b5d5e7f61dcbe (table test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]) successfully deleted
I20260811 18:53:55.329461 23199 ts_tablet_manager.cc:1918] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:53:55.334893 23199 log.cc:1196] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/efcd58c58c234c2ba82b5d5e7f61dcbe
I20260811 18:53:55.335927 23199 ts_tablet_manager.cc:1939] T efcd58c58c234c2ba82b5d5e7f61dcbe P b2ccab3b11b446a7b7343e2279ae18b9: Deleting consensus metadata
I20260811 18:53:55.344156 22131 catalog_manager.cc:4841] TS b2ccab3b11b446a7b7343e2279ae18b9 (127.19.155.195:45075): tablet efcd58c58c234c2ba82b5d5e7f61dcbe (table test-table [id=6ba695a61cf1464bbb8c19d4f29c3e5e]) successfully deleted
I20260811 18:53:55.344667 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.303222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.19.155.193:46581)
0811 18:53:55.303434 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.303440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.314479 (+ 11039us) server_negotiation.cc:407] Connection header received
0811 18:53:55.314915 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.314923 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.315028 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.315115 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:55.320307 (+ 5192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.321574 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.329373 (+ 7799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.330127 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.330251 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.336059 (+ 5808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:55.336078 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:55.336102 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:55.336148 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:55.340538 (+ 4390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.341478 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.341489 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.341493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.341651 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.342136 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.342141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.342144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.342674 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:55.343024 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.343650 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.343910 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 18:53:55.346289 22510 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42072
I20260811 18:53:55.384805 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.360255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33330 (local address 127.19.155.254:46761)
0811 18:53:55.360446 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.360453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.367155 (+ 6702us) server_negotiation.cc:407] Connection header received
0811 18:53:55.367585 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.367592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.367692 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.367777 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:55.369853 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.371075 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.372987 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.373679 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.373791 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.377137 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:55.377144 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:55.377149 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:55.377191 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:55.381399 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.382301 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.382308 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.382311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.382459 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.382959 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.382964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.382968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.383363 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:55.383577 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.384201 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.384449 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 18:53:55.386415 22149 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33330
I20260811 18:53:55.388867 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22281
I20260811 18:53:55.407068 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.390228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.19.155.193:46581)
0811 18:53:55.390407 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.390414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.391362 (+ 948us) server_negotiation.cc:407] Connection header received
0811 18:53:55.391501 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.391507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.391597 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.391712 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:55.393204 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.394376 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.396211 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.397024 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.397161 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.400094 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:55.400103 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:55.400108 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:55.400147 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:55.404010 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.404824 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.404832 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.404838 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.405008 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.405431 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.405436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.405440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.405786 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:55.406082 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.406379 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.406632 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 18:53:55.407874 22510 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42074
W20260811 18:53:55.408499 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22281: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:55.408690 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22281
I20260811 18:53:55.438998 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22530
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:53:55.457060 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.439806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53190 (local address 127.19.155.194:44985)
0811 18:53:55.440002 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.440007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.440024 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:53:55.440211 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.440215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.440286 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.440373 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:55.441985 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.442733 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.444731 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.445152 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.445252 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.450099 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:55.450115 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:55.450137 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:55.450186 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:55.454129 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.454787 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.454799 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.454803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.455003 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.455467 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.455473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.455477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.455933 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:55.456272 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.456412 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.456654 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 18:53:55.457803 22768 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53190
W20260811 18:53:55.458462 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22530: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:55.458642 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22530
I20260811 18:53:55.491466 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22781
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[22074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474434, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:53:55.506125 23065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:55.492193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54064 (local address 127.19.155.195:45075)
0811 18:53:55.492374 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:55.492378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:55.492415 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:53:55.492588 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:55.492592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:55.492656 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:55.492744 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:55.493954 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.494647 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.495901 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:55.496310 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:55.496403 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:55.500884 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:55.500899 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:55.500917 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:55.500951 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:55.503797 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.504399 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.504406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.504409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.504539 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:55.504853 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:55.504856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:55.504858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:55.505174 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:55.505412 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:55.505707 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 18:53:55.505870 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 18:53:55.506768 23018 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54064
W20260811 18:53:55.507411 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22781: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:53:55.507539 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22781
I20260811 18:53:55.539069 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22095
I20260811 18:53:55.540198 22229 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:53:55.654688 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22095
2026-08-11T18:53:55Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5046 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[23212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[23212](info): set up 2 sockets
Aug 11 18:53:55 dist-test-slave-1nl6 krb5kdc[23212](info): commencing operation
krb5kdc: starting...
W20260811 18:53:56.979614 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:53:57 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:53:57.181829 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36877
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:36877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:57.500553 23239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:57.500885 23239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:57.501047 23239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:57.508023 23239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:57.508155 23239 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:53:57.508241 23239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:57.508354 23239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:57.508440 23239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:57.508527 23239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:57.518163 23239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:36877
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:57.519385 23239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:57.520686 23239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:57.532025 23246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:57.532068 23249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:57.532117 23247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:57.533344 23239 server_base.cc:1034] running on GCE node
I20260811 18:53:57.534078 23239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:57.535346 23239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:57.536579 23239 hybrid_clock.cc:648] HybridClock initialized: now 1786474437536512 us; error 48 us; skew 500 ppm
I20260811 18:53:57.536890 23239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:57 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:57.539984 23239 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:53:57.541329 23239 webserver.cc:460] Webserver started at http://127.19.155.254:34757/ using document root <none> and password file <none>
I20260811 18:53:57.541939 23239 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:57.542024 23239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:57.542279 23239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:57.545043 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "aea77d1eabe94768918f2ca7ccf37d5c"
format_stamp: "Formatted at 2026-08-11 18:53:57 on dist-test-slave-1nl6"
server_key: "c5f4506fb689cb284bd440518874fb5f"
server_key_iv: "20213495c13e637d9269da13a6b94327"
server_key_version: "encryptionkey@0"
I20260811 18:53:57.545778 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "aea77d1eabe94768918f2ca7ccf37d5c"
format_stamp: "Formatted at 2026-08-11 18:53:57 on dist-test-slave-1nl6"
server_key: "c5f4506fb689cb284bd440518874fb5f"
server_key_iv: "20213495c13e637d9269da13a6b94327"
server_key_version: "encryptionkey@0"
I20260811 18:53:57.550631 23239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260811 18:53:57.553813 23258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:57.555099 23239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:53:57.555245 23239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "aea77d1eabe94768918f2ca7ccf37d5c"
format_stamp: "Formatted at 2026-08-11 18:53:57 on dist-test-slave-1nl6"
server_key: "c5f4506fb689cb284bd440518874fb5f"
server_key_iv: "20213495c13e637d9269da13a6b94327"
server_key_version: "encryptionkey@0"
I20260811 18:53:57.555415 23239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:57.600071 23239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:57.604039 23239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:57.604279 23239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:57.625160 23239 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:36877
I20260811 18:53:57.625167 23379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:36877 every 8 connection(s)
I20260811 18:53:57.626573 23239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:57.629240 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23239
I20260811 18:53:57.629470 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:53:57.630132 20079 external_mini_cluster.cc:1428] Setting key efde7a459ca3e10261fe6a7ba25ed175
I20260811 18:53:57.630529 23380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:57.644992 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Bootstrap starting.
Aug 11 18:53:57 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:57.648197 23380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:57.649247 23380 log.cc:824] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:57.651949 23380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: No bootstrap required, opened a new log
I20260811 18:53:57.653239 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:57.632151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43284 (local address 127.19.155.254:36877)
0811 18:53:57.632960 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:57.632971 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:57.633012 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:53:57.635198 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:57.635221 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:57.635574 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:57.635918 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:57.637734 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:57.639041 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:57.640763 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:57.641412 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:57.641544 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:57.646285 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:57.646296 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:57.646310 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:57.646353 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:57.649358 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:57.650061 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:57.650078 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:57.650084 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:57.650261 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:57.650627 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:57.650632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:57.650635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:57.651182 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:57.651468 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:57.651914 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 18:53:57.652341 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":396,"threads_started":1}
I20260811 18:53:57.660543 23380 raft_consensus.cc:348] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } }
I20260811 18:53:57.660893 23380 raft_consensus.cc:374] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:57.660995 23380 raft_consensus.cc:729] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea77d1eabe94768918f2ca7ccf37d5c, State: Initialized, Role: FOLLOWER
I20260811 18:53:57.661525 23380 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } }
I20260811 18:53:57.661799 23380 raft_consensus.cc:388] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:57.661942 23380 raft_consensus.cc:482] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:57.662122 23380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:57.664605 23380 raft_consensus.cc:504] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } }
I20260811 18:53:57.665081 23380 leader_election.cc:302] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aea77d1eabe94768918f2ca7ccf37d5c; no voters:
I20260811 18:53:57.665655 23380 leader_election.cc:288] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:57.665793 23386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:57.666572 23386 raft_consensus.cc:686] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [term 1 LEADER]: Becoming Leader. State: Replica: aea77d1eabe94768918f2ca7ccf37d5c, State: Running, Role: LEADER
I20260811 18:53:57.667120 23386 consensus_queue.cc:237] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } }
I20260811 18:53:57.667776 23380 sys_catalog.cc:564] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:57.669636 23394 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader aea77d1eabe94768918f2ca7ccf37d5c. Latest consensus state: current_term: 1 leader_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } } }
I20260811 18:53:57.670017 23394 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:57.670974 23399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:57.670750 23393 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea77d1eabe94768918f2ca7ccf37d5c" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36877 } } }
I20260811 18:53:57.671321 23393 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:57.676411 23399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:57.686556 23399 catalog_manager.cc:1347] Generated new cluster ID: 8047079381434882be891bec0251db87
I20260811 18:53:57.686671 23399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:57.705044 23399 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:57.706837 23399 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:57.723549 23399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Generated new TSK 0
I20260811 18:53:57.724526 23399 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:53:57.775874 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36877
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:58.108714 23436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:58.109027 23436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:58.109207 23436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:58.116186 23436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:58.116326 23436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:58.116472 23436 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:53:58.116555 23436 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:58.116662 23436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:53:58.126370 23436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:36877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:58.127898 23436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:58.129213 23436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:58.143944 23448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:58.144018 23447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:58.144049 23450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:58.145313 23436 server_base.cc:1034] running on GCE node
I20260811 18:53:58.146098 23436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:58.147147 23436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:58.148388 23436 hybrid_clock.cc:648] HybridClock initialized: now 1786474438148315 us; error 50 us; skew 500 ppm
I20260811 18:53:58.148797 23436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:58 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:58.151996 23436 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:53:58.153520 23436 webserver.cc:460] Webserver started at http://127.19.155.193:42941/ using document root <none> and password file <none>
I20260811 18:53:58.154177 23436 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:58.154322 23436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:58.154667 23436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:58.157570 23436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "d585bc12abf646f09c00a68005382d97"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1befaa1a639e0e1f7e9ab58bf8c856ae"
server_key_iv: "95a36524f111b63b0f4c8abf8c756108"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.158366 23436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "d585bc12abf646f09c00a68005382d97"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1befaa1a639e0e1f7e9ab58bf8c856ae"
server_key_iv: "95a36524f111b63b0f4c8abf8c756108"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.163630 23436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:53:58.167112 23461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:58.168448 23436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:53:58.168642 23436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "d585bc12abf646f09c00a68005382d97"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1befaa1a639e0e1f7e9ab58bf8c856ae"
server_key_iv: "95a36524f111b63b0f4c8abf8c756108"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.168848 23436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:58.188025 23436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:58.195179 23436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:58.195487 23436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:58.198232 23436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:58.198364 23436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:58.198508 23436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:58.198598 23436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:58 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:58.221877 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.198606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:34663 (local address 127.19.155.254:36877)
0811 18:53:58.199224 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:58.199231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:58.200507 (+ 1276us) server_negotiation.cc:407] Connection header received
0811 18:53:58.202527 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:58.202533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:58.202629 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:58.202778 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:58.204900 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.206200 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.208672 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.209220 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.209358 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.214872 (+ 5514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:58.214882 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:58.214887 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:58.214958 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:58.218194 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.219191 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.219196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.219200 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.219355 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.219977 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.219982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.219986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.220393 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:58.220562 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:58.221257 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 18:53:58.221476 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":271,"threads_started":1}
I20260811 18:53:58.223064 23480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.199392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.193:34663)
0811 18:53:58.200318 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:58.200368 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:58.202246 (+ 1878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:58.203089 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:58.203099 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:58.203836 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:58.204676 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.204700 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.206406 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.206413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.208512 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.208527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.209485 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.209493 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.209836 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.210644 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:58.210681 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:58.214579 (+ 3898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:58.218347 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.218362 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.218382 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.219061 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.219498 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.219505 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.219511 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.219841 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.220543 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:58.220554 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:58.220901 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 18:53:58.221162 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 18:53:58.221685 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":394,"threads_started":1}
I20260811 18:53:58.243849 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.229219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:35245 (local address 127.19.155.254:36877)
0811 18:53:58.229417 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:58.229424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:58.230259 (+ 835us) server_negotiation.cc:407] Connection header received
0811 18:53:58.230403 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:58.230411 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:58.230514 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:58.230657 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:58.231592 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.232989 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.234241 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.235125 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.235289 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.237951 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:58.237960 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:58.237965 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:58.238007 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:58.240708 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.241583 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.241587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.241589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.241728 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.242316 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.242322 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.242328 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.242613 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:58.242779 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:58.243279 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 18:53:58.243504 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:53:58.243968 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.229532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.193:35245)
0811 18:53:58.230159 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:58.230177 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:58.230286 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:58.230670 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:58.230673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:58.231164 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:58.231454 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.231463 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.233126 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.233129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.234100 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.234112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.235345 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.235353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.235590 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.236249 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:58.236279 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:58.237739 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:58.240845 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.240850 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.240854 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.241410 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.241884 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.241892 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.241897 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.242122 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.242739 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:58.242744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:58.242997 (+ 253us) client_negotiation.cc:769] Sending connection context
0811 18:53:58.243171 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 18:53:58.243498 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":322,"threads_started":1}
I20260811 18:53:58.249961 23436 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35335
I20260811 18:53:58.250001 23685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35335 every 8 connection(s)
I20260811 18:53:58.251207 23436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:58.253101 23686 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36877
I20260811 18:53:58.253350 23686 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:58.254010 23686 heartbeater.cc:511] Master 127.19.155.254:36877 requested a full tablet report, sending...
I20260811 18:53:58.255893 23287 ts_manager.cc:194] Registered new tserver with Master: d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335)
I20260811 18:53:58.256649 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23436
I20260811 18:53:58.256853 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:58.257308 23287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:34663
I20260811 18:53:58.257543 20079 external_mini_cluster.cc:1428] Setting key 31c5803049b4243554b09fa1d2e27c84
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:53:58.303668 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36877
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:58.630517 23692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:58.630846 23692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:58.631053 23692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:58.638325 23692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:58.638486 23692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:58.638628 23692 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:53:58.638716 23692 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:58.638852 23692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:53:58.648654 23692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:36877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:58.649919 23692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:58.651314 23692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:58.664376 23700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:58.664422 23703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:58.664446 23698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:58.665450 23692 server_base.cc:1034] running on GCE node
I20260811 18:53:58.666083 23692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:58.667027 23692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:58.668260 23692 hybrid_clock.cc:648] HybridClock initialized: now 1786474438668185 us; error 59 us; skew 500 ppm
I20260811 18:53:58.668533 23692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:58 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:58.671653 23692 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:53:58.673149 23692 webserver.cc:460] Webserver started at http://127.19.155.194:40209/ using document root <none> and password file <none>
I20260811 18:53:58.673869 23692 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:58.674005 23692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:58.674331 23692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:58.677318 23692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1a55b94720e58f3f3fb4748c3212c1c4"
server_key_iv: "ec4537c08151a39292c5cb58443c8d3e"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.678099 23692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1a55b94720e58f3f3fb4748c3212c1c4"
server_key_iv: "ec4537c08151a39292c5cb58443c8d3e"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.683168 23692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260811 18:53:58.686414 23719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:58.687666 23692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:58.687835 23692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
format_stamp: "Formatted at 2026-08-11 18:53:58 on dist-test-slave-1nl6"
server_key: "1a55b94720e58f3f3fb4748c3212c1c4"
server_key_iv: "ec4537c08151a39292c5cb58443c8d3e"
server_key_version: "encryptionkey@0"
I20260811 18:53:58.688026 23692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:58.698670 23692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:58.702384 23692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:58.702661 23692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:58.705199 23692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:58.705338 23692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:58.705458 23692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:58.705554 23692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:58 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:58.729492 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.705919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:45635 (local address 127.19.155.254:36877)
0811 18:53:58.706148 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:58.706155 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:58.707623 (+ 1468us) server_negotiation.cc:407] Connection header received
0811 18:53:58.709809 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:58.709815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:58.709909 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:58.710022 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:58.711913 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.713271 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.715752 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.716556 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.716691 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.721922 (+ 5231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:58.721933 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:58.721941 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:58.721996 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:58.725546 (+ 3550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.726775 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.726781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.726788 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.726990 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.727581 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.727589 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.727593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.728040 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:58.728203 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:58.728928 (+ 725us) server_negotiation.cc:299] Negotiation successful
0811 18:53:58.729153 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:53:58.730479 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.706614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.194:45635)
0811 18:53:58.707459 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:58.707498 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:58.709469 (+ 1971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:58.710262 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:58.710270 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:58.710747 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:58.711622 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.711674 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.713465 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.713472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.715500 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.715515 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.716781 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.716786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.716949 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.717694 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:58.717734 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:58.721611 (+ 3877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:58.725706 (+ 4095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.725720 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.725743 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.726616 (+ 873us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.727141 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.727146 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.727150 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.727425 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.728208 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:58.728222 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:58.728539 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 18:53:58.728803 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 18:53:58.729313 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":392,"threads_started":1}
I20260811 18:53:58.752816 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.738391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:47711 (local address 127.19.155.254:36877)
0811 18:53:58.738599 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:58.738608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:58.739825 (+ 1217us) server_negotiation.cc:407] Connection header received
0811 18:53:58.739929 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:58.739937 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:58.740041 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:58.740169 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:58.740997 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.742435 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.744293 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.744674 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.744806 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.746593 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:58.746598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:58.746620 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:58.746650 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:58.749648 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.750573 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.750582 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.750585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.750763 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:58.751246 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:58.751253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:58.751256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:58.751560 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:58.751742 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:58.752380 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 18:53:58.752538 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:53:58.753364 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:58.738963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.194:47711)
0811 18:53:58.739670 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:58.739710 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:58.739835 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:58.740182 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:58.740185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:58.740574 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:58.740858 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.740867 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.742577 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.742581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.744104 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:58.744126 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:58.744879 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:58.744886 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:58.745054 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:58.745626 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:58.745641 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:58.746410 (+ 769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:58.749829 (+ 3419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.749834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.749838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.750438 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.750953 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:58.750964 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:58.750967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:58.751115 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:58.751742 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:58.751751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:58.752056 (+ 305us) client_negotiation.cc:769] Sending connection context
0811 18:53:58.752259 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 18:53:58.752697 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":437,"threads_started":1}
I20260811 18:53:58.759512 23692 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:36399
I20260811 18:53:58.759552 23921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:36399 every 8 connection(s)
I20260811 18:53:58.760689 23692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:58.762579 23922 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36877
I20260811 18:53:58.762764 23922 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:58.763440 23922 heartbeater.cc:511] Master 127.19.155.254:36877 requested a full tablet report, sending...
I20260811 18:53:58.764397 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23692
I20260811 18:53:58.764571 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:58.764752 23287 ts_manager.cc:194] Registered new tserver with Master: f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399)
I20260811 18:53:58.765051 20079 external_mini_cluster.cc:1428] Setting key 307f936d0acfa515159e5ea61838ebee
I20260811 18:53:58.765583 23287 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:45635
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:53:58.809871 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36877
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:59.146293 23931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:59.146579 23931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:59.146764 23931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:59.154177 23931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:59.154294 23931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:59.154475 23931 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:53:59.154559 23931 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:59.154678 23931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:53:59.164505 23931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:36877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:53:59.165791 23931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:59.167157 23931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:59.180565 23936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:59.180610 23938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:59.180930 23942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:59.181862 23931 server_base.cc:1034] running on GCE node
I20260811 18:53:59.182425 23931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:59.183434 23931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:59.184633 23931 hybrid_clock.cc:648] HybridClock initialized: now 1786474439184572 us; error 50 us; skew 500 ppm
I20260811 18:53:59.184948 23931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:53:59 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:59.188230 23931 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:53:59.189640 23931 webserver.cc:460] Webserver started at http://127.19.155.195:36677/ using document root <none> and password file <none>
I20260811 18:53:59.190331 23931 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:59.190483 23931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:59.190850 23931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:59.193933 23931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "ab96185eb3654c76959ccd833d0bb1d2"
format_stamp: "Formatted at 2026-08-11 18:53:59 on dist-test-slave-1nl6"
server_key: "52fc1c21a46a9bd184b7d8c923876a46"
server_key_iv: "882172e8bd73164fb97a610ae53fa1a2"
server_key_version: "encryptionkey@0"
I20260811 18:53:59.194739 23931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "ab96185eb3654c76959ccd833d0bb1d2"
format_stamp: "Formatted at 2026-08-11 18:53:59 on dist-test-slave-1nl6"
server_key: "52fc1c21a46a9bd184b7d8c923876a46"
server_key_iv: "882172e8bd73164fb97a610ae53fa1a2"
server_key_version: "encryptionkey@0"
I20260811 18:53:59.199929 23931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 18:53:59.203485 23954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:59.204811 23931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 18:53:59.205084 23931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "ab96185eb3654c76959ccd833d0bb1d2"
format_stamp: "Formatted at 2026-08-11 18:53:59 on dist-test-slave-1nl6"
server_key: "52fc1c21a46a9bd184b7d8c923876a46"
server_key_iv: "882172e8bd73164fb97a610ae53fa1a2"
server_key_version: "encryptionkey@0"
I20260811 18:53:59.205287 23931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:59.218030 23931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:59.222335 23931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:59.222620 23931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:59.225265 23931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:59.225441 23931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:59.225591 23931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:59.225746 23931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:59 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:59.249333 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.225854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:60761 (local address 127.19.155.254:36877)
0811 18:53:59.226052 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.226058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.227531 (+ 1473us) server_negotiation.cc:407] Connection header received
0811 18:53:59.229763 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.229772 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.229890 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.230009 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:59.232361 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.233667 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.236185 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.236617 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.236756 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.241211 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:59.241224 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:59.241232 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:59.241305 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:59.245087 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.246207 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.246214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.246218 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.246392 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.246969 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.246975 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.246979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.247452 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:59.247643 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.248485 (+ 842us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.248799 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:53:59.249898 23972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.226369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.195:60761)
0811 18:53:59.227358 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.227414 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.229476 (+ 2062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.230272 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.230281 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.231088 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:59.232120 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.232180 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.233879 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.233888 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.236019 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.236033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.236866 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.236874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.237078 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.237821 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:59.237842 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:59.240874 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:59.245238 (+ 4364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.245248 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.245268 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.246010 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.246507 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.246513 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.246516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.246797 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.247638 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:59.247650 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:59.248046 (+ 396us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.248272 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.248650 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":392,"threads_started":1}
I20260811 18:53:59.260344 23686 heartbeater.cc:503] Master 127.19.155.254:36877 was elected leader, sending a full tablet report...
I20260811 18:53:59.277249 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.261859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.19.155.195:34621)
0811 18:53:59.262539 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.262556 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.262713 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.263100 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.263105 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.263595 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:59.263888 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.263898 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.264885 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.264891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.265938 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.265949 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.267142 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.267153 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.267424 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.268246 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:59.268276 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:59.269458 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:59.273429 (+ 3971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.273437 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.273446 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.274235 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.274808 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.274816 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.274822 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.275052 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.275622 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:59.275630 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:59.275904 (+ 274us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.276099 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.276547 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":985,"threads_started":1}
I20260811 18:53:59.278621 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.261893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:34621 (local address 127.19.155.254:36877)
0811 18:53:59.262323 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.262332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.262640 (+ 308us) server_negotiation.cc:407] Connection header received
0811 18:53:59.262836 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.262842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.262966 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.263072 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:59.264031 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.264746 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.266103 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.266636 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.266770 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.269639 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:59.269646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:59.269651 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:59.269690 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:59.273192 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.274439 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.274448 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.274452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.274635 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.275218 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.275222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.275224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.275487 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:59.275613 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.277739 (+ 2126us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.278065 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257}
I20260811 18:53:59.290979 23931 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:44409
I20260811 18:53:59.291021 24156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:44409 every 8 connection(s)
I20260811 18:53:59.292533 23931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:59.294528 24157 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36877
I20260811 18:53:59.294760 24157 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:59.295463 24157 heartbeater.cc:511] Master 127.19.155.254:36877 requested a full tablet report, sending...
I20260811 18:53:59.296882 23286 ts_manager.cc:194] Registered new tserver with Master: ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:53:59.297696 23286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:60761
I20260811 18:53:59.298817 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23931
I20260811 18:53:59.299029 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:59.299467 20079 external_mini_cluster.cc:1428] Setting key 78d6360b8e40b1fbae9df2e309ad406c
I20260811 18:53:59.302142 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:53:59 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:53:59 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:59.353691 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.340492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43292 (local address 127.19.155.254:36877)
0811 18:53:59.340735 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.340742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.340916 (+ 174us) server_negotiation.cc:407] Connection header received
0811 18:53:59.341072 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.341076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.341146 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.341243 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:59.342563 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.343373 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.344564 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.344973 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.345079 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.348815 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:59.348820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:59.348823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:59.348854 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:59.351326 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.351879 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.351883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.351885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.351996 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.352341 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.352345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.352347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.352645 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:59.352866 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.353096 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.353264 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:53:59.357555 23286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:59.364419 23286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:59.388732 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.377380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:36399 (local address 127.0.0.1:58910)
0811 18:53:59.380068 (+ 2688us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.380089 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.380301 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.381364 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.381371 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.381400 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:59.381936 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.381956 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.383863 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.383868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.385947 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.385963 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.387641 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.387647 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.387883 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.387934 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.388081 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.388272 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2543,"mutex_wait_us":27,"thread_start_us":788,"threads_started":1}
I20260811 18:53:59.389575 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.377974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58910 (local address 127.19.155.194:36399)
0811 18:53:59.379652 (+ 1678us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.379665 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.380183 (+ 518us) server_negotiation.cc:407] Connection header received
0811 18:53:59.380517 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.380526 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.380839 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.381045 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:59.382191 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.383685 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.386121 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.387136 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.387329 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.387511 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.389129 (+ 1618us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.389300 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1466,"thread_start_us":1307,"threads_started":1}
I20260811 18:53:59.389667 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.376589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44409 (local address 127.0.0.1:41880)
0811 18:53:59.378657 (+ 2068us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.378712 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.378973 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.382101 (+ 3128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.382106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.382129 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:59.382455 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.382463 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.384737 (+ 2274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.384745 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.387083 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.387103 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.388914 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.388920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.389062 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.389094 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.389159 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.389294 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1702,"mutex_wait_us":79,"thread_start_us":3189,"threads_started":1}
I20260811 18:53:59.390482 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.381365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.0.0.1:39950)
0811 18:53:59.381969 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.381989 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.382098 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.383935 (+ 1837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.383940 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.383964 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:59.384418 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.384428 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.386288 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.386294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.388053 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.388067 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.389622 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.389628 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.389785 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.389822 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.389927 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.390056 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"spinlock_wait_cycles":896,"thread_start_us":439,"threads_started":1}
I20260811 18:53:59.390640 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.376885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.19.155.195:44409)
0811 18:53:59.381488 (+ 4603us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.381494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.381542 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:53:59.381644 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.381653 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.381888 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.382595 (+ 707us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:59.382841 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.384580 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.387264 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.388689 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.389850 (+ 1161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.390011 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.390077 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.390260 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4461,"thread_start_us":4267,"threads_started":1}
I20260811 18:53:59.391114 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.380452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.19.155.193:35335)
0811 18:53:59.383417 (+ 2965us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.383425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.383449 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:53:59.383536 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.383543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.383731 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.384634 (+ 903us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:59.384843 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.386149 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.388232 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.389404 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.389599 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.389753 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.390533 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.390746 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2804,"thread_start_us":2662,"threads_started":1}
I20260811 18:53:59.394145 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (DEFAULT_TABLE table=test-table [id=96697e08dd8444da8f654e29a5e26b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.394167 24041 tablet_service.cc:1467] Processing CreateTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (DEFAULT_TABLE table=test-table [id=96697e08dd8444da8f654e29a5e26b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.394358 23554 tablet_service.cc:1467] Processing CreateTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (DEFAULT_TABLE table=test-table [id=96697e08dd8444da8f654e29a5e26b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.395522 23554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.395615 24041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.395615 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.407975 24191 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Bootstrap starting.
I20260811 18:53:59.410440 24193 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Bootstrap starting.
I20260811 18:53:59.411834 24191 tablet_bootstrap.cc:654] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.411897 24194 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Bootstrap starting.
I20260811 18:53:59.413244 24191 log.cc:824] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:59.414264 24193 tablet_bootstrap.cc:654] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.414955 24194 tablet_bootstrap.cc:654] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.415494 24193 log.cc:824] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:59.416256 24194 log.cc:824] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:59.416545 24191 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: No bootstrap required, opened a new log
I20260811 18:53:59.416841 24191 ts_tablet_manager.cc:1397] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 18:53:59.418521 24193 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: No bootstrap required, opened a new log
I20260811 18:53:59.418777 24193 ts_tablet_manager.cc:1397] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 18:53:59.420586 24194 tablet_bootstrap.cc:492] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: No bootstrap required, opened a new log
I20260811 18:53:59.420835 24194 ts_tablet_manager.cc:1397] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 18:53:59.427604 24191 raft_consensus.cc:348] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.428064 24191 raft_consensus.cc:374] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.428206 24191 raft_consensus.cc:729] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d585bc12abf646f09c00a68005382d97, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.428359 24194 raft_consensus.cc:348] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.428764 24194 raft_consensus.cc:374] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.428885 24194 raft_consensus.cc:729] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.428864 24191 consensus_queue.cc:260] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.429479 24194 consensus_queue.cc:260] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.429256 24193 raft_consensus.cc:348] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.429755 24193 raft_consensus.cc:374] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.429878 24193 raft_consensus.cc:729] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.430526 23922 heartbeater.cc:503] Master 127.19.155.254:36877 was elected leader, sending a full tablet report...
I20260811 18:53:59.430768 24193 consensus_queue.cc:260] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.431231 24194 ts_tablet_manager.cc:1428] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260811 18:53:59.432617 24157 heartbeater.cc:503] Master 127.19.155.254:36877 was elected leader, sending a full tablet report...
I20260811 18:53:59.433243 24193 ts_tablet_manager.cc:1428] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 18:53:59.434549 24191 ts_tablet_manager.cc:1428] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
W20260811 18:53:59.503930 23688 tablet.cc:2369] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:59.512768 23923 tablet.cc:2369] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:59.543280 24201 raft_consensus.cc:482] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:59.543551 24201 raft_consensus.cc:504] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
W20260811 18:53:59.544170 24159 tablet.cc:2369] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:59.545324 24201 leader_election.cc:288] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409), f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399)
I20260811 18:53:59.551677 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.545963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:35705 (local address 127.19.155.194:36399)
0811 18:53:59.546210 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.546219 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.546477 (+ 258us) server_negotiation.cc:407] Connection header received
0811 18:53:59.546711 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.546717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.546781 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.546874 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:59.547459 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.548176 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.550001 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.550738 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.550932 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.551016 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.551289 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.551414 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:53:59.551757 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.545675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:36399 (local address 127.19.155.193:35705)
0811 18:53:59.546372 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.546389 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.546568 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.546893 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.546920 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.546946 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:59.547307 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.547316 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.548313 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.548321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.549834 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.549847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.550974 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.550981 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.551128 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.551152 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.551263 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.551391 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":373,"threads_started":1}
I20260811 18:53:59.551831 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.545791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:58531 (local address 127.19.155.195:44409)
0811 18:53:59.546036 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.546044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.546787 (+ 743us) server_negotiation.cc:407] Connection header received
0811 18:53:59.546996 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.547001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.547065 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.547164 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:59.547722 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.548426 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.550114 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.550870 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.551105 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.551180 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.551450 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.551572 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:53:59.551908 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.545773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44409 (local address 127.19.155.193:58531)
0811 18:53:59.546669 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.546686 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.546843 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.547186 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.547190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.547215 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:59.547570 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.547579 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.548577 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.548583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.549949 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.549962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.551137 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.551143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.551287 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.551313 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.551411 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.551532 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":626,"threads_started":1}
I20260811 18:53:59.553030 23839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a2d80d2fb9145b0bcc6649dd57b11f0" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" is_pre_election: true
I20260811 18:53:59.553033 24088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a2d80d2fb9145b0bcc6649dd57b11f0" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2" is_pre_election: true
I20260811 18:53:59.553568 24088 raft_consensus.cc:2454] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 0.
I20260811 18:53:59.553602 23839 raft_consensus.cc:2454] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 0.
I20260811 18:53:59.554211 23470 leader_election.cc:302] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:53:59.554606 24201 raft_consensus.cc:2781] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:59.554751 24201 raft_consensus.cc:482] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:59.554901 24201 raft_consensus.cc:3037] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.557097 24201 raft_consensus.cc:504] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.557750 24201 leader_election.cc:288] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 election: Requested vote from peers ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409), f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399)
I20260811 18:53:59.558118 24088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a2d80d2fb9145b0bcc6649dd57b11f0" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2"
I20260811 18:53:59.558195 23839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a2d80d2fb9145b0bcc6649dd57b11f0" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
I20260811 18:53:59.558312 24088 raft_consensus.cc:3037] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.558418 23839 raft_consensus.cc:3037] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.560741 24088 raft_consensus.cc:2454] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 1.
I20260811 18:53:59.560779 23839 raft_consensus.cc:2454] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 1.
I20260811 18:53:59.561146 23470 leader_election.cc:302] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:53:59.561419 24201 raft_consensus.cc:2781] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:59.561861 24201 raft_consensus.cc:686] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 1 LEADER]: Becoming Leader. State: Replica: d585bc12abf646f09c00a68005382d97, State: Running, Role: LEADER
I20260811 18:53:59.562325 24201 consensus_queue.cc:237] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } }
I20260811 18:53:59.566985 23286 catalog_manager.cc:5495] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 reported cstate change: term changed from 0 to 1, leader changed from <none> to d585bc12abf646f09c00a68005382d97 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:53:59 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:53:59.658208 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.645428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36877 (local address 127.0.0.1:43298)
0811 18:53:59.646022 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.646041 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.646170 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.646488 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.646491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.647258 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:59.647544 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.647554 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.648539 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.648544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.649504 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.649516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.650184 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.650189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.650307 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.650892 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:59.650929 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:59.653133 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:59.655843 (+ 2710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.655857 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.655866 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.656367 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.656683 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:59.656686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:59.656688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:59.656842 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:59.657306 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:59.657312 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:59.657454 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.657589 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.657780 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":325,"threads_started":1}
I20260811 18:53:59.658303 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.645397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43298 (local address 127.19.155.254:36877)
0811 18:53:59.645567 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.645572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.646132 (+ 560us) server_negotiation.cc:407] Connection header received
0811 18:53:59.646278 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.646282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.646359 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.646445 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:59.647674 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.648397 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.649626 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.650030 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.650117 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.653315 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:59.653319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:59.653323 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:59.653393 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:59.655710 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.656465 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.656469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.656471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.656592 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:59.656930 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:59.656933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:59.656935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:59.657187 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:59.657304 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.657671 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.657941 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":61}
I20260811 18:53:59.663816 23286 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43298:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:53:59.664816 23286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:59.671352 23554 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee13ca1a821435cbbcad8d874882c88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e38c77a7b1f4a3d91a9994c0092de17]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:59.671438 23806 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee13ca1a821435cbbcad8d874882c88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e38c77a7b1f4a3d91a9994c0092de17]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:59.671700 24041 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee13ca1a821435cbbcad8d874882c88 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e38c77a7b1f4a3d91a9994c0092de17]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:59.672408 23554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee13ca1a821435cbbcad8d874882c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.672408 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee13ca1a821435cbbcad8d874882c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.672675 24041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee13ca1a821435cbbcad8d874882c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.678221 24193 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: Bootstrap starting.
I20260811 18:53:59.679737 24193 tablet_bootstrap.cc:654] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.679798 24191 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: Bootstrap starting.
I20260811 18:53:59.680208 24194 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: Bootstrap starting.
I20260811 18:53:59.681397 24191 tablet_bootstrap.cc:654] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.681891 24194 tablet_bootstrap.cc:654] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.682178 24193 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: No bootstrap required, opened a new log
I20260811 18:53:59.682366 24193 ts_tablet_manager.cc:1397] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:53:59.683442 24193 raft_consensus.cc:348] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.683768 24193 raft_consensus.cc:374] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.683854 24193 raft_consensus.cc:729] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.684123 24193 consensus_queue.cc:260] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.684860 24193 ts_tablet_manager.cc:1428] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:53:59.684646 24203 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.685035 24203 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.685132 24191 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: No bootstrap required, opened a new log
I20260811 18:53:59.684366 24194 tablet_bootstrap.cc:492] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: No bootstrap required, opened a new log
I20260811 18:53:59.685285 24191 ts_tablet_manager.cc:1397] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 18:53:59.685371 24194 ts_tablet_manager.cc:1397] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 18:53:59.685938 24191 raft_consensus.cc:348] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.686141 24191 raft_consensus.cc:374] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.686237 24191 raft_consensus.cc:729] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d585bc12abf646f09c00a68005382d97, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.686169 24194 raft_consensus.cc:348] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.686440 24194 raft_consensus.cc:374] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.686547 24194 raft_consensus.cc:729] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.686475 24191 consensus_queue.cc:260] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.686782 24194 consensus_queue.cc:260] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.686944 24201 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.687217 24201 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.687394 24194 ts_tablet_manager.cc:1428] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:53:59.687646 24202 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.688015 24202 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.688455 24191 ts_tablet_manager.cc:1428] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 18:53:59.732760 24201 raft_consensus.cc:482] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:59.732991 24201 raft_consensus.cc:504] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.733778 24201 leader_election.cc:288] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:53:59.734258 23839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee13ca1a821435cbbcad8d874882c88" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" is_pre_election: true
I20260811 18:53:59.734432 24088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee13ca1a821435cbbcad8d874882c88" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2" is_pre_election: true
I20260811 18:53:59.734560 23839 raft_consensus.cc:2454] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 0.
I20260811 18:53:59.734709 24088 raft_consensus.cc:2454] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 0.
I20260811 18:53:59.735033 23470 leader_election.cc:302] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:53:59.735380 24201 raft_consensus.cc:2781] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:59.735495 24201 raft_consensus.cc:482] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:59.735575 24201 raft_consensus.cc:3037] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.737658 24201 raft_consensus.cc:504] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.738247 24201 leader_election.cc:288] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 election: Requested vote from peers f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:53:59.738644 23839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee13ca1a821435cbbcad8d874882c88" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
I20260811 18:53:59.738669 24088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee13ca1a821435cbbcad8d874882c88" candidate_uuid: "d585bc12abf646f09c00a68005382d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2"
I20260811 18:53:59.738863 23839 raft_consensus.cc:3037] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.738891 24088 raft_consensus.cc:3037] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:59.741039 24088 raft_consensus.cc:2454] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 1.
I20260811 18:53:59.741451 23471 leader_election.cc:302] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab96185eb3654c76959ccd833d0bb1d2, d585bc12abf646f09c00a68005382d97; no voters:
I20260811 18:53:59.741740 24201 raft_consensus.cc:2781] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:59.741930 24201 raft_consensus.cc:686] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [term 1 LEADER]: Becoming Leader. State: Replica: d585bc12abf646f09c00a68005382d97, State: Running, Role: LEADER
I20260811 18:53:59.741966 23839 raft_consensus.cc:2454] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d585bc12abf646f09c00a68005382d97 in term 1.
I20260811 18:53:59.742192 24201 consensus_queue.cc:237] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.743856 24207 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: TxnStatusTablet state changed. Reason: New leader d585bc12abf646f09c00a68005382d97. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.744266 24207 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:59.745008 24227 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:53:59.745288 24227 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:53:59.745450 23285 catalog_manager.cc:5495] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 reported cstate change: term changed from 0 to 1, leader changed from <none> to d585bc12abf646f09c00a68005382d97 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:59.783267 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.776301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.19.155.193:35335)
0811 18:53:59.776511 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.776518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.776584 (+ 66us) server_negotiation.cc:407] Connection header received
0811 18:53:59.776916 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.776921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.777060 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.777222 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:59.777698 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.779036 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.781021 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.781434 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.781533 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.782126 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:59.782640 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:59.782778 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.782976 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.783052 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:53:59.783406 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.776240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.0.0.1:39964)
0811 18:53:59.776505 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.776526 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.776682 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.777274 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.777279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.777293 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:59.777512 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.777528 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.779204 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.779211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.780869 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.780886 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.781596 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.781606 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.781836 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.781920 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:59.782774 (+ 854us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:59.782799 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.782889 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.783077 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 18:53:59.790593 23839 raft_consensus.cc:1261] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Refusing update from remote peer d585bc12abf646f09c00a68005382d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:59.790725 24088 raft_consensus.cc:1261] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Refusing update from remote peer d585bc12abf646f09c00a68005382d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:59.791664 24207 consensus_queue.cc:1035] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:59.792008 24201 consensus_queue.cc:1035] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:59.800575 24203 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: TxnStatusTablet state changed. Reason: New leader d585bc12abf646f09c00a68005382d97. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.800861 24203 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.806813 24207 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.806823 24203 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.807068 24203 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P ab96185eb3654c76959ccd833d0bb1d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.807083 24207 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:59.808806 24232 mvcc.cc:205] Tried to move back new op lower bound from 7317399305373069312 to 7317399305186881536. Current Snapshot: MvccSnapshot[applied={T|T < 7317399305373069312}]
I20260811 18:53:59.814224 24201 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.814296 24202 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: TxnStatusTablet state changed. Reason: New leader d585bc12abf646f09c00a68005382d97. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.814574 24201 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P d585bc12abf646f09c00a68005382d97: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:59.814579 24202 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.816684 24236 mvcc.cc:205] Tried to move back new op lower bound from 7317399305373069312 to 7317399305186881536. Current Snapshot: MvccSnapshot[applied={T|T < 7317399305373069312}]
I20260811 18:53:59.819078 24202 tablet_replica.cc:439] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d585bc12abf646f09c00a68005382d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } } }
I20260811 18:53:59.819336 24202 tablet_replica.cc:442] T 8ee13ca1a821435cbbcad8d874882c88 P f49e5ea799214cb2af7e2133ceebb3a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:59.827610 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.822150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.19.155.193:35335)
0811 18:53:59.822336 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.822343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.822539 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:53:59.822753 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.822762 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.822854 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.823022 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:59.823486 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.824317 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.825729 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.826249 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.826422 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.826810 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:59.826978 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:59.827074 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.827228 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.827312 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:53:59.843662 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.837936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:56031 (local address 127.19.155.193:35335)
0811 18:53:59.838080 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.838084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:59.838767 (+ 683us) server_negotiation.cc:407] Connection header received
0811 18:53:59.838985 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:59.838990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:59.839053 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:59.839140 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:59.839661 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.840396 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.841820 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.842241 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.842380 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.842831 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:59.842975 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:59.843064 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:59.843202 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 18:53:59.843321 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":38}
I20260811 18:53:59.843792 24250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.838032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.19.155.193:56031)
0811 18:53:59.838659 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.838675 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:59.838831 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:59.839153 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:59.839157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:59.839167 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:59.839512 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.839523 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.840530 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.840536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.841662 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:59.841677 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:59.842446 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:59.842452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:59.842568 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:59.842617 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:59.843065 (+ 448us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:59.843077 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:53:59.843183 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:53:59.843344 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":5,"thread_start_us":350,"threads_started":1}
I20260811 18:53:59.852965 24088 raft_consensus.cc:1261] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Refusing update from remote peer d585bc12abf646f09c00a68005382d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:59.853000 23839 raft_consensus.cc:1261] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Refusing update from remote peer d585bc12abf646f09c00a68005382d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:59.853559 24207 consensus_queue.cc:1035] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:59.853904 24201 consensus_queue.cc:1035] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:59.862954 24233 mvcc.cc:205] Tried to move back new op lower bound from 7317399305632489472 to 7317399304451117056. Current Snapshot: MvccSnapshot[applied={T|T < 7317399305632489472}]
I20260811 18:53:59.926834 23286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:59.927181 23286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:59.930560 23286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Sending DeleteTablet for 3 replicas of tablet 9a2d80d2fb9145b0bcc6649dd57b11f0
I20260811 18:53:59.931815 24041 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:41880
I20260811 18:53:59.931820 23553 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 18:53:59.931915 23806 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:58910
I20260811 18:53:59.935743 23285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:59.936595 23285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:59.945353 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (DEFAULT_TABLE table=test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.945350 24039 tablet_service.cc:1467] Processing CreateTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (DEFAULT_TABLE table=test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.945904 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c2c34f6349d497786aad1f4b1e2f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.945909 24039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c2c34f6349d497786aad1f4b1e2f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.951114 23554 tablet_service.cc:1467] Processing CreateTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (DEFAULT_TABLE table=test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:59.951656 23554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c2c34f6349d497786aad1f4b1e2f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:59.955720 24262 tablet_replica.cc:330] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: stopping tablet replica
I20260811 18:53:59.956185 24262 raft_consensus.cc:2229] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:59.956562 24262 raft_consensus.cc:2258] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:59.959800 24262 ts_tablet_manager.cc:1905] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:59.963117 24194 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Bootstrap starting.
I20260811 18:53:59.963181 24193 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Bootstrap starting.
I20260811 18:53:59.964896 24194 tablet_bootstrap.cc:654] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.965394 24193 tablet_bootstrap.cc:654] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.970136 24262 ts_tablet_manager.cc:1918] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:59.970347 24262 log.cc:1196] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/9a2d80d2fb9145b0bcc6649dd57b11f0
I20260811 18:53:59.971004 24262 ts_tablet_manager.cc:1939] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting consensus metadata
I20260811 18:53:59.974680 23262 catalog_manager.cc:4841] TS f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399): tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (table test-table [id=96697e08dd8444da8f654e29a5e26b39]) successfully deleted
I20260811 18:53:59.975270 24194 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: No bootstrap required, opened a new log
I20260811 18:53:59.975447 24194 ts_tablet_manager.cc:1397] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260811 18:53:59.976193 24194 raft_consensus.cc:348] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.976436 24194 raft_consensus.cc:374] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.976517 24194 raft_consensus.cc:729] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.976747 24194 consensus_queue.cc:260] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.977406 24194 ts_tablet_manager.cc:1428] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:53:59.978366 24193 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: No bootstrap required, opened a new log
I20260811 18:53:59.978575 24193 ts_tablet_manager.cc:1397] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s
I20260811 18:53:59.979568 24193 raft_consensus.cc:348] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.979872 24193 raft_consensus.cc:374] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.979957 24193 raft_consensus.cc:729] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.980330 24193 consensus_queue.cc:260] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.980967 24193 ts_tablet_manager.cc:1428] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:53:59.981359 24191 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Bootstrap starting.
I20260811 18:53:59.983819 24191 tablet_bootstrap.cc:654] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:59.985285 24261 tablet_replica.cc:330] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: stopping tablet replica
I20260811 18:53:59.986346 24261 raft_consensus.cc:2229] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:59.987710 24261 raft_consensus.cc:2258] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:59.988441 24191 tablet_bootstrap.cc:492] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: No bootstrap required, opened a new log
I20260811 18:53:59.988659 24191 ts_tablet_manager.cc:1397] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260811 18:53:59.989288 24191 raft_consensus.cc:348] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.989531 24191 raft_consensus.cc:374] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:59.989630 24191 raft_consensus.cc:729] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d585bc12abf646f09c00a68005382d97, State: Initialized, Role: FOLLOWER
I20260811 18:53:59.989885 24191 consensus_queue.cc:260] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.990499 24191 ts_tablet_manager.cc:1428] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 18:53:59.991454 24259 tablet_replica.cc:330] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: stopping tablet replica
I20260811 18:53:59.991937 24259 raft_consensus.cc:2229] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:59.992347 24259 raft_consensus.cc:2258] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:59.992990 24261 ts_tablet_manager.cc:1905] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:59.994251 24259 ts_tablet_manager.cc:1905] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:59.995275 24202 raft_consensus.cc:482] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:59.995507 24202 raft_consensus.cc:504] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:53:59.997267 24202 leader_election.cc:288] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:54:00.001595 24259 ts_tablet_manager.cc:1918] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:00.001775 24259 log.cc:1196] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/9a2d80d2fb9145b0bcc6649dd57b11f0
I20260811 18:54:00.001827 24261 ts_tablet_manager.cc:1918] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:00.002030 24261 log.cc:1196] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/9a2d80d2fb9145b0bcc6649dd57b11f0
I20260811 18:54:00.002292 24259 ts_tablet_manager.cc:1939] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P ab96185eb3654c76959ccd833d0bb1d2: Deleting consensus metadata
I20260811 18:54:00.002709 24261 ts_tablet_manager.cc:1939] T 9a2d80d2fb9145b0bcc6649dd57b11f0 P d585bc12abf646f09c00a68005382d97: Deleting consensus metadata
I20260811 18:54:00.004225 23263 catalog_manager.cc:4841] TS ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409): tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (table test-table [id=96697e08dd8444da8f654e29a5e26b39]) successfully deleted
I20260811 18:54:00.004506 23263 catalog_manager.cc:4841] TS d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335): tablet 9a2d80d2fb9145b0bcc6649dd57b11f0 (table test-table [id=96697e08dd8444da8f654e29a5e26b39]) successfully deleted
I20260811 18:54:00.008358 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.998065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39627 (local address 127.19.155.193:35335)
0811 18:53:59.998259 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:59.998270 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:00.000141 (+ 1871us) server_negotiation.cc:407] Connection header received
0811 18:54:00.000491 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:00.000496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:00.000566 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:00.000625 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:00.001459 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.002681 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.005922 (+ 3241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.007185 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.007346 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.007433 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:00.007894 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 18:54:00.008045 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:54:00.008468 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.997613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.19.155.194:39627)
0811 18:53:59.999559 (+ 1946us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:59.999582 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:00.000291 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:00.000816 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:00.000821 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:00.000848 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:00.001231 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.001249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.003254 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.003260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.005747 (+ 2487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.005763 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.007423 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.007431 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.007684 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.007727 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:54:00.007849 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 18:54:00.007998 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1790,"mutex_wait_us":46,"thread_start_us":1644,"threads_started":1}
I20260811 18:54:00.009423 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c2c34f6349d497786aad1f4b1e2f8b7" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97" is_pre_election: true
I20260811 18:54:00.009886 23599 raft_consensus.cc:2454] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 0.
I20260811 18:54:00.010547 23723 leader_election.cc:302] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:00.011009 24202 raft_consensus.cc:2781] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:00.011162 24202 raft_consensus.cc:482] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:00.011277 24202 raft_consensus.cc:3037] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:00.013696 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.999880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:55655 (local address 127.19.155.195:44409)
0811 18:54:00.000050 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:00.000055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:00.004987 (+ 4932us) server_negotiation.cc:407] Connection header received
0811 18:54:00.005262 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:00.005268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:00.005345 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:00.005407 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:00.006329 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.007436 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.009889 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.010973 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.011135 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.011231 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:00.013259 (+ 2028us) server_negotiation.cc:299] Negotiation successful
0811 18:54:00.013403 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:54:00.014572 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:59.999715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44409 (local address 127.19.155.194:55655)
0811 18:54:00.004885 (+ 5170us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:00.004906 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:00.005088 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:00.005615 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:00.005620 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:00.005662 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:00.006150 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.006164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.007580 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.007587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.009625 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.009687 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.012826 (+ 3139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.012833 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.013042 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.013076 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:54:00.013929 (+ 853us) client_negotiation.cc:240] Negotiation successful
0811 18:54:00.014071 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5033,"mutex_wait_us":45,"thread_start_us":4968,"threads_started":1}
I20260811 18:54:00.014460 24202 raft_consensus.cc:504] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:00.015210 24202 leader_election.cc:288] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 election: Requested vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:54:00.015257 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c2c34f6349d497786aad1f4b1e2f8b7" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2" is_pre_election: true
I20260811 18:54:00.015537 24086 raft_consensus.cc:2454] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 0.
I20260811 18:54:00.016355 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c2c34f6349d497786aad1f4b1e2f8b7" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2"
I20260811 18:54:00.016412 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c2c34f6349d497786aad1f4b1e2f8b7" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97"
I20260811 18:54:00.016553 24086 raft_consensus.cc:3037] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:00.016615 23599 raft_consensus.cc:3037] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:00.018575 24086 raft_consensus.cc:2454] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 1.
I20260811 18:54:00.018962 23723 leader_election.cc:302] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab96185eb3654c76959ccd833d0bb1d2, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:00.019237 24202 raft_consensus.cc:2781] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:00.019718 24202 raft_consensus.cc:686] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 LEADER]: Becoming Leader. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Running, Role: LEADER
I20260811 18:54:00.020083 24202 consensus_queue.cc:237] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:00.020306 23599 raft_consensus.cc:2454] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 1.
I20260811 18:54:00.023561 23285 catalog_manager.cc:5495] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:00.046945 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:00.041439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58924 (local address 127.19.155.194:36399)
0811 18:54:00.041905 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:00.041910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:00.041922 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:54:00.041992 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:00.041995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:00.042071 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:00.042252 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:00.042628 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.043478 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.044785 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.045186 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.045316 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.045732 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:00.046295 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:00.046453 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:00.046534 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:54:00.046615 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358}
I20260811 18:54:00.062848 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:00.057325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:51863 (local address 127.19.155.193:35335)
0811 18:54:00.057480 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:00.057484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:00.058014 (+ 530us) server_negotiation.cc:407] Connection header received
0811 18:54:00.058211 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:00.058217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:00.058333 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:00.058420 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:00.058955 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.059644 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.061050 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.061482 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.061638 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.062035 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:00.062146 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:00.062239 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:00.062397 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 18:54:00.062478 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:54:00.062912 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:00.057347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.19.155.194:51863)
0811 18:54:00.057907 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:00.057922 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:00.058086 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:00.058436 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:00.058442 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:00.058453 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:00.058788 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.058797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.059833 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.059839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.060908 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.060919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.061664 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.061670 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.061812 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.061861 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:00.062250 (+ 389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:00.062288 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:54:00.062370 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:54:00.062498 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":304,"threads_started":1}
I20260811 18:54:00.071148 24086 raft_consensus.cc:1261] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Refusing update from remote peer f49e5ea799214cb2af7e2133ceebb3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:00.071573 23599 raft_consensus.cc:1261] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Refusing update from remote peer f49e5ea799214cb2af7e2133ceebb3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:00.072319 24270 consensus_queue.cc:1035] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:00.072748 24202 consensus_queue.cc:1035] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:00.107882 24250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:00.099563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:36399 (local address 127.19.155.193:42063)
0811 18:54:00.100220 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:00.100253 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:00.100372 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:00.101230 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:00.101235 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:00.101248 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:00.101434 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.101445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.102926 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.102933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.104496 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:00.104513 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.106774 (+ 2261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.106780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:00.106964 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.107020 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:00.107466 (+ 446us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:00.107476 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:54:00.107546 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:54:00.107647 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452}
I20260811 18:54:00.108345 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:00.100574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:42063 (local address 127.19.155.194:36399)
0811 18:54:00.100792 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:00.100799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:00.100819 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:00.100887 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:00.100892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:00.100968 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:00.101058 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:00.101601 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.102720 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.105883 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:00.106499 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:00.106629 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:00.107222 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:00.107343 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:00.107436 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:00.107598 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 18:54:00.107690 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:54:00.109553 24236 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:54:01.731381 23285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:01.731632 23285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:01.735606 23285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Sending DeleteTablet for 3 replicas of tablet 9c2c34f6349d497786aad1f4b1e2f8b7
I20260811 18:54:01.736308 23553 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:01 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 18:54:01.736399 23805 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:01 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:58910
I20260811 18:54:01.736488 24041 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c2c34f6349d497786aad1f4b1e2f8b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:01 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:41880
I20260811 18:54:01.748159 24330 tablet_replica.cc:330] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: stopping tablet replica
I20260811 18:54:01.748601 24330 raft_consensus.cc:2229] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:01.749010 24330 raft_consensus.cc:2258] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:01.750468 24330 ts_tablet_manager.cc:1905] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:01.753819 24326 tablet_replica.cc:330] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: stopping tablet replica
I20260811 18:54:01.753995 24329 tablet_replica.cc:330] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: stopping tablet replica
I20260811 18:54:01.754036 24326 raft_consensus.cc:2229] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:01.754200 24329 raft_consensus.cc:2229] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:01.754297 24326 raft_consensus.cc:2258] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:01.754814 24329 raft_consensus.cc:2258] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:01.755623 24326 ts_tablet_manager.cc:1905] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:01.755739 24329 ts_tablet_manager.cc:1905] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:01.761974 24329 ts_tablet_manager.cc:1918] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:01.762104 24329 log.cc:1196] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/9c2c34f6349d497786aad1f4b1e2f8b7
I20260811 18:54:01.762594 24329 ts_tablet_manager.cc:1939] T 9c2c34f6349d497786aad1f4b1e2f8b7 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting consensus metadata
I20260811 18:54:01.763578 24326 ts_tablet_manager.cc:1918] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:01.763716 24326 log.cc:1196] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/9c2c34f6349d497786aad1f4b1e2f8b7
I20260811 18:54:01.763687 23262 catalog_manager.cc:4841] TS f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399): tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (table test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]) successfully deleted
I20260811 18:54:01.764219 24326 ts_tablet_manager.cc:1939] T 9c2c34f6349d497786aad1f4b1e2f8b7 P d585bc12abf646f09c00a68005382d97: Deleting consensus metadata
I20260811 18:54:01.765340 23263 catalog_manager.cc:4841] TS d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335): tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (table test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]) successfully deleted
I20260811 18:54:01.765528 24330 ts_tablet_manager.cc:1918] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:01.765686 24330 log.cc:1196] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/9c2c34f6349d497786aad1f4b1e2f8b7
I20260811 18:54:01.766062 24330 ts_tablet_manager.cc:1939] T 9c2c34f6349d497786aad1f4b1e2f8b7 P ab96185eb3654c76959ccd833d0bb1d2: Deleting consensus metadata
I20260811 18:54:01.767046 23263 catalog_manager.cc:4841] TS ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409): tablet 9c2c34f6349d497786aad1f4b1e2f8b7 (table test-table [id=74eb9ef55bd5460fb9d4be3be07c4f88]) successfully deleted
Aug 11 18:54:01 dist-test-slave-1nl6 krb5kdc[23212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:54:01 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:01.807632 24341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:01.793298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43306 (local address 127.19.155.254:36877)
0811 18:54:01.794026 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:01.794032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:01.794058 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:54:01.794187 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:01.794191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:01.794257 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:01.794378 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:01.795802 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:01.796590 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:01.797845 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:01.798276 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:01.798420 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:01.802305 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:01.802310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:01.802314 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:01.802348 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:01.805207 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:01.805886 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:01.805890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:01.805892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:01.806018 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:01.806316 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:01.806320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:01.806322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:01.806582 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:01.806784 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:01.807095 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 18:54:01.807277 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":369,"threads_started":1}
I20260811 18:54:01.810967 23285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:01.811638 23285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:01.818011 23553 tablet_service.cc:1467] Processing CreateTablet for tablet 348f855bdd0041eb8635f593a555b921 (DEFAULT_TABLE table=test-table [id=bce6c81384b84d3490a6e25092237fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:01.818200 23805 tablet_service.cc:1467] Processing CreateTablet for tablet 348f855bdd0041eb8635f593a555b921 (DEFAULT_TABLE table=test-table [id=bce6c81384b84d3490a6e25092237fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:01.818500 23553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 348f855bdd0041eb8635f593a555b921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:01.818675 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 348f855bdd0041eb8635f593a555b921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:01.823243 24342 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Bootstrap starting.
I20260811 18:54:01.823380 24346 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Bootstrap starting.
I20260811 18:54:01.823386 24041 tablet_service.cc:1467] Processing CreateTablet for tablet 348f855bdd0041eb8635f593a555b921 (DEFAULT_TABLE table=test-table [id=bce6c81384b84d3490a6e25092237fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:01.823864 24041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 348f855bdd0041eb8635f593a555b921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:01.824982 24342 tablet_bootstrap.cc:654] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:01.825183 24346 tablet_bootstrap.cc:654] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:01.827499 24342 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: No bootstrap required, opened a new log
I20260811 18:54:01.827638 24342 ts_tablet_manager.cc:1397] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 18:54:01.827765 24346 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: No bootstrap required, opened a new log
I20260811 18:54:01.827915 24346 ts_tablet_manager.cc:1397] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 18:54:01.828531 24342 raft_consensus.cc:348] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.828776 24342 raft_consensus.cc:374] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:01.828862 24342 raft_consensus.cc:729] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d585bc12abf646f09c00a68005382d97, State: Initialized, Role: FOLLOWER
I20260811 18:54:01.828745 24346 raft_consensus.cc:348] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.828972 24346 raft_consensus.cc:374] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:01.829077 24346 raft_consensus.cc:729] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Initialized, Role: FOLLOWER
I20260811 18:54:01.829093 24342 consensus_queue.cc:260] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.829361 24346 consensus_queue.cc:260] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.829694 24342 ts_tablet_manager.cc:1428] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:54:01.829917 24346 ts_tablet_manager.cc:1428] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 18:54:01.831674 24350 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Bootstrap starting.
I20260811 18:54:01.833530 24350 tablet_bootstrap.cc:654] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:01.835649 24350 tablet_bootstrap.cc:492] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: No bootstrap required, opened a new log
I20260811 18:54:01.835753 24350 ts_tablet_manager.cc:1397] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:54:01.836589 24350 raft_consensus.cc:348] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.836936 24350 raft_consensus.cc:374] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:01.837081 24350 raft_consensus.cc:729] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Initialized, Role: FOLLOWER
I20260811 18:54:01.837340 24350 consensus_queue.cc:260] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:01.838064 24350 ts_tablet_manager.cc:1428] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:54:02.052258 24352 raft_consensus.cc:482] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:02.052526 24352 raft_consensus.cc:504] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.054590 24352 leader_election.cc:288] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399)
I20260811 18:54:02.073424 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.055410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:37787 (local address 127.19.155.194:36399)
0811 18:54:02.065489 (+ 10079us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.065495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.066127 (+ 632us) server_negotiation.cc:407] Connection header received
0811 18:54:02.066290 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.066296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.066380 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.066482 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:02.067336 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.068485 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.070663 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.071959 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.072153 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.072234 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.072880 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.073049 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9941,"thread_start_us":9805,"threads_started":1}
I20260811 18:54:02.073486 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.054871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:36399 (local address 127.19.155.195:37787)
0811 18:54:02.065997 (+ 11126us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:02.066020 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:02.066143 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:02.066721 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:02.066725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:02.066751 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:02.067119 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.067137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.068646 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.068650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.070516 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.070527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.072389 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.072396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.072638 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.072725 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 18:54:02.072830 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:54:02.073012 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10973,"mutex_wait_us":59,"thread_start_us":9491,"threads_started":1}
I20260811 18:54:02.073698 24354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.054833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.19.155.195:43709)
0811 18:54:02.064719 (+ 9886us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:02.064735 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:02.064895 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:02.065530 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:02.065536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:02.065571 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:02.065952 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.065969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.067729 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.067734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.070126 (+ 2392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.070142 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.072199 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.072246 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.072638 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.072748 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 18:54:02.072856 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:54:02.073049 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9754,"mutex_wait_us":96,"thread_start_us":10829,"threads_started":1}
I20260811 18:54:02.074209 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.054891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:43709 (local address 127.19.155.193:35335)
0811 18:54:02.055666 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.055676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.064825 (+ 9149us) server_negotiation.cc:407] Connection header received
0811 18:54:02.065046 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.065053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.065158 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.065274 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:02.066269 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.067578 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.070300 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.071905 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.072142 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.072242 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.073710 (+ 1468us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.073858 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":649,"threads_started":1}
I20260811 18:54:02.074433 23838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "348f855bdd0041eb8635f593a555b921" candidate_uuid: "ab96185eb3654c76959ccd833d0bb1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" is_pre_election: true
I20260811 18:54:02.074713 23838 raft_consensus.cc:2454] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab96185eb3654c76959ccd833d0bb1d2 in term 0.
I20260811 18:54:02.074867 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "348f855bdd0041eb8635f593a555b921" candidate_uuid: "ab96185eb3654c76959ccd833d0bb1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97" is_pre_election: true
I20260811 18:54:02.075158 23599 raft_consensus.cc:2454] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab96185eb3654c76959ccd833d0bb1d2 in term 0.
I20260811 18:54:02.075322 23960 leader_election.cc:302] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab96185eb3654c76959ccd833d0bb1d2, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:02.075850 24352 raft_consensus.cc:2781] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:02.076011 24352 raft_consensus.cc:482] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:02.076144 24352 raft_consensus.cc:3037] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.080044 24352 raft_consensus.cc:504] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.080848 24352 leader_election.cc:288] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [CANDIDATE]: Term 1 election: Requested vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399)
I20260811 18:54:02.081300 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "348f855bdd0041eb8635f593a555b921" candidate_uuid: "ab96185eb3654c76959ccd833d0bb1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97"
I20260811 18:54:02.081355 23838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "348f855bdd0041eb8635f593a555b921" candidate_uuid: "ab96185eb3654c76959ccd833d0bb1d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49e5ea799214cb2af7e2133ceebb3a5"
I20260811 18:54:02.081542 23599 raft_consensus.cc:3037] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.081570 23838 raft_consensus.cc:3037] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.083794 23838 raft_consensus.cc:2454] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab96185eb3654c76959ccd833d0bb1d2 in term 1.
I20260811 18:54:02.084219 23960 leader_election.cc:302] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab96185eb3654c76959ccd833d0bb1d2, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:02.084499 24352 raft_consensus.cc:2781] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:02.084697 23599 raft_consensus.cc:2454] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab96185eb3654c76959ccd833d0bb1d2 in term 1.
I20260811 18:54:02.085119 24352 raft_consensus.cc:686] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 LEADER]: Becoming Leader. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Running, Role: LEADER
I20260811 18:54:02.085979 24352 consensus_queue.cc:237] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.090468 23287 catalog_manager.cc:5495] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "ab96185eb3654c76959ccd833d0bb1d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } health_report { overall_health: HEALTHY } } }
I20260811 18:54:02.135354 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.129307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.19.155.195:44409)
0811 18:54:02.129920 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.129924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.129942 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:54:02.130024 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.130027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.130098 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.130286 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:02.130734 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.131616 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.132956 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.133394 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.133526 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.134057 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.134660 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.134832 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.134911 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.135014 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":317,"threads_started":1}
I20260811 18:54:02.151998 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.147099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:49769 (local address 127.19.155.193:35335)
0811 18:54:02.147344 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.147354 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.147773 (+ 419us) server_negotiation.cc:407] Connection header received
0811 18:54:02.147914 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.147918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.147984 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.148058 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:02.148486 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.149128 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.150430 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.150822 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.150970 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.151454 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.151546 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.151612 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.151745 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.151804 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:54:02.152099 24373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.147060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35335 (local address 127.19.155.195:49769)
0811 18:54:02.147679 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:02.147694 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:02.147822 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:02.148082 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:02.148085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:02.148094 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:02.148371 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.148378 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.149256 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.149273 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.150312 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.150323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.151084 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.151089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.151244 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.151297 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.151632 (+ 335us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.151647 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:54:02.151710 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:54:02.151805 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":334,"threads_started":1}
I20260811 18:54:02.160734 23838 raft_consensus.cc:1261] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Refusing update from remote peer ab96185eb3654c76959ccd833d0bb1d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:02.160876 23599 raft_consensus.cc:1261] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Refusing update from remote peer ab96185eb3654c76959ccd833d0bb1d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:02.161492 24359 consensus_queue.cc:1035] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:02.161895 24352 consensus_queue.cc:1035] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:02.189356 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.183831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:34295 (local address 127.19.155.195:44409)
0811 18:54:02.184016 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.184024 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.184212 (+ 188us) server_negotiation.cc:407] Connection header received
0811 18:54:02.184415 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.184420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.184489 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.184579 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:02.185059 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.185951 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.187662 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.188088 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.188237 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.188634 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.188728 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.188843 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.188986 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.189064 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:02.189464 24379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.183441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44409 (local address 127.19.155.193:34295)
0811 18:54:02.184105 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:02.184127 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:02.184281 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:02.184598 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:02.184603 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:02.184615 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:02.184907 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.184917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.186081 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.186087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.187511 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:02.187526 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.188272 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.188279 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:02.188438 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.188475 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.188844 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.188858 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:54:02.188949 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:54:02.189076 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":393,"threads_started":1}
I20260811 18:54:02.221704 23287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:02.222070 23287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:02.225198 23287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Sending DeleteTablet for 3 replicas of tablet 348f855bdd0041eb8635f593a555b921
I20260811 18:54:02.226127 23805 tablet_service.cc:1514] Processing DeleteTablet for tablet 348f855bdd0041eb8635f593a555b921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:02 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:58910
I20260811 18:54:02.226368 24041 tablet_service.cc:1514] Processing DeleteTablet for tablet 348f855bdd0041eb8635f593a555b921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:02 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:41880
I20260811 18:54:02.226468 24329 tablet_replica.cc:330] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: stopping tablet replica
I20260811 18:54:02.226696 24329 raft_consensus.cc:2229] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:02.226753 24330 tablet_replica.cc:330] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: stopping tablet replica
I20260811 18:54:02.226891 24329 raft_consensus.cc:2258] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:02.226959 24330 raft_consensus.cc:2229] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:02.227146 23287 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:54:02.227502 24330 raft_consensus.cc:2258] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 18:54:02.227769 23287 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:02.228327 24329 ts_tablet_manager.cc:1905] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:02.229266 24330 ts_tablet_manager.cc:1905] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:02.235013 24329 ts_tablet_manager.cc:1918] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:02.235205 24329 log.cc:1196] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/348f855bdd0041eb8635f593a555b921
I20260811 18:54:02.235234 23553 tablet_service.cc:1514] Processing DeleteTablet for tablet 348f855bdd0041eb8635f593a555b921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:02 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 18:54:02.235559 24326 tablet_replica.cc:330] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: stopping tablet replica
I20260811 18:54:02.235668 24329 ts_tablet_manager.cc:1939] T 348f855bdd0041eb8635f593a555b921 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting consensus metadata
I20260811 18:54:02.235798 24326 raft_consensus.cc:2229] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:02.235718 23554 tablet_service.cc:1467] Processing CreateTablet for tablet c30e571d88a14bd98a8e271311cf2e85 (DEFAULT_TABLE table=test-table [id=4e079f45da8849df89b647e7a3769d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:02.236016 24326 raft_consensus.cc:2258] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:02.236207 23554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30e571d88a14bd98a8e271311cf2e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:02.237217 24326 ts_tablet_manager.cc:1905] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:02.237985 24330 ts_tablet_manager.cc:1918] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:02.238225 24330 log.cc:1196] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/348f855bdd0041eb8635f593a555b921
I20260811 18:54:02.238736 24330 ts_tablet_manager.cc:1939] T 348f855bdd0041eb8635f593a555b921 P ab96185eb3654c76959ccd833d0bb1d2: Deleting consensus metadata
I20260811 18:54:02.239500 23805 tablet_service.cc:1467] Processing CreateTablet for tablet c30e571d88a14bd98a8e271311cf2e85 (DEFAULT_TABLE table=test-table [id=4e079f45da8849df89b647e7a3769d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:02.239923 23805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30e571d88a14bd98a8e271311cf2e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:02.243072 23262 catalog_manager.cc:4841] TS f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399): tablet 348f855bdd0041eb8635f593a555b921 (table test-table [id=bce6c81384b84d3490a6e25092237fd8]) successfully deleted
I20260811 18:54:02.243428 23263 catalog_manager.cc:4841] TS ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409): tablet 348f855bdd0041eb8635f593a555b921 (table test-table [id=bce6c81384b84d3490a6e25092237fd8]) successfully deleted
I20260811 18:54:02.244071 24326 ts_tablet_manager.cc:1918] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:02.244298 24326 log.cc:1196] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/348f855bdd0041eb8635f593a555b921
I20260811 18:54:02.244787 24326 ts_tablet_manager.cc:1939] T 348f855bdd0041eb8635f593a555b921 P d585bc12abf646f09c00a68005382d97: Deleting consensus metadata
I20260811 18:54:02.245380 24342 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Bootstrap starting.
I20260811 18:54:02.245610 24041 tablet_service.cc:1467] Processing CreateTablet for tablet c30e571d88a14bd98a8e271311cf2e85 (DEFAULT_TABLE table=test-table [id=4e079f45da8849df89b647e7a3769d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:02.245916 23263 catalog_manager.cc:4841] TS d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335): tablet 348f855bdd0041eb8635f593a555b921 (table test-table [id=bce6c81384b84d3490a6e25092237fd8]) successfully deleted
I20260811 18:54:02.246043 24041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30e571d88a14bd98a8e271311cf2e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:02.247062 24342 tablet_bootstrap.cc:654] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:02.247370 24346 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Bootstrap starting.
I20260811 18:54:02.249066 24346 tablet_bootstrap.cc:654] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:02.249092 24342 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: No bootstrap required, opened a new log
I20260811 18:54:02.249413 24342 ts_tablet_manager.cc:1397] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 18:54:02.250298 24342 raft_consensus.cc:348] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.250649 24342 raft_consensus.cc:374] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:02.250787 24342 raft_consensus.cc:729] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d585bc12abf646f09c00a68005382d97, State: Initialized, Role: FOLLOWER
I20260811 18:54:02.252357 24350 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Bootstrap starting.
I20260811 18:54:02.252791 24342 consensus_queue.cc:260] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.253563 24342 ts_tablet_manager.cc:1428] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 18:54:02.253944 24350 tablet_bootstrap.cc:654] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:02.262681 24346 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: No bootstrap required, opened a new log
I20260811 18:54:02.262929 24346 ts_tablet_manager.cc:1397] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.000s
I20260811 18:54:02.263597 24346 raft_consensus.cc:348] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.263831 24346 raft_consensus.cc:374] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:02.263942 24346 raft_consensus.cc:729] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Initialized, Role: FOLLOWER
I20260811 18:54:02.264210 24346 consensus_queue.cc:260] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.264782 24346 ts_tablet_manager.cc:1428] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:54:02.270412 24350 tablet_bootstrap.cc:492] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: No bootstrap required, opened a new log
I20260811 18:54:02.270610 24350 ts_tablet_manager.cc:1397] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.009s
I20260811 18:54:02.271488 24350 raft_consensus.cc:348] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.271770 24350 raft_consensus.cc:374] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:02.271883 24350 raft_consensus.cc:729] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab96185eb3654c76959ccd833d0bb1d2, State: Initialized, Role: FOLLOWER
I20260811 18:54:02.272157 24350 consensus_queue.cc:260] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.272750 24350 ts_tablet_manager.cc:1428] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:54:02.335929 24318 raft_consensus.cc:482] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:02.336169 24318 raft_consensus.cc:504] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.336891 24318 leader_election.cc:288] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:54:02.337514 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30e571d88a14bd98a8e271311cf2e85" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97" is_pre_election: true
I20260811 18:54:02.337597 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30e571d88a14bd98a8e271311cf2e85" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2" is_pre_election: true
I20260811 18:54:02.337795 23599 raft_consensus.cc:2454] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 0.
I20260811 18:54:02.337872 24086 raft_consensus.cc:2454] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 0.
I20260811 18:54:02.338279 23723 leader_election.cc:302] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:02.338591 24318 raft_consensus.cc:2781] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:02.338716 24318 raft_consensus.cc:482] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:02.338842 24318 raft_consensus.cc:3037] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.340912 24318 raft_consensus.cc:504] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.341507 24318 leader_election.cc:288] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 election: Requested vote from peers d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335), ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409)
I20260811 18:54:02.341986 23599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30e571d88a14bd98a8e271311cf2e85" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d585bc12abf646f09c00a68005382d97"
I20260811 18:54:02.342110 24086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30e571d88a14bd98a8e271311cf2e85" candidate_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab96185eb3654c76959ccd833d0bb1d2"
I20260811 18:54:02.342190 23599 raft_consensus.cc:3037] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.342334 24086 raft_consensus.cc:3037] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:02.344375 23599 raft_consensus.cc:2454] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 1.
I20260811 18:54:02.344763 23723 leader_election.cc:302] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d585bc12abf646f09c00a68005382d97, f49e5ea799214cb2af7e2133ceebb3a5; no voters:
I20260811 18:54:02.345036 24318 raft_consensus.cc:2781] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:02.345484 24318 raft_consensus.cc:686] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 LEADER]: Becoming Leader. State: Replica: f49e5ea799214cb2af7e2133ceebb3a5, State: Running, Role: LEADER
I20260811 18:54:02.345606 24086 raft_consensus.cc:2454] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49e5ea799214cb2af7e2133ceebb3a5 in term 1.
I20260811 18:54:02.346238 24318 consensus_queue.cc:237] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } }
I20260811 18:54:02.349138 23287 catalog_manager.cc:5495] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f49e5ea799214cb2af7e2133ceebb3a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 36399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:02.373883 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:02.368522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58934 (local address 127.19.155.194:36399)
0811 18:54:02.368700 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:02.368705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:02.368724 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:02.368871 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:02.368877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:02.369012 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:02.369114 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:02.369486 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.370620 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.371980 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:02.372658 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:02.372807 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:02.373167 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:02.373303 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:02.373404 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:02.373525 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 18:54:02.373599 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:54:02.383512 23599 raft_consensus.cc:1261] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Refusing update from remote peer f49e5ea799214cb2af7e2133ceebb3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:02.383512 24086 raft_consensus.cc:1261] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Refusing update from remote peer f49e5ea799214cb2af7e2133ceebb3a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:02.384094 24318 consensus_queue.cc:1035] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab96185eb3654c76959ccd833d0bb1d2" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:02.384409 24386 consensus_queue.cc:1035] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d585bc12abf646f09c00a68005382d97" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:54:02.407101 24299 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:54:03.991142 23285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:03.991412 23285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:03.995421 23285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aea77d1eabe94768918f2ca7ccf37d5c: Sending DeleteTablet for 3 replicas of tablet c30e571d88a14bd98a8e271311cf2e85
I20260811 18:54:03.996186 23554 tablet_service.cc:1514] Processing DeleteTablet for tablet c30e571d88a14bd98a8e271311cf2e85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:03 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 18:54:03.996404 24041 tablet_service.cc:1514] Processing DeleteTablet for tablet c30e571d88a14bd98a8e271311cf2e85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:03 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:41880
I20260811 18:54:03.996445 23805 tablet_service.cc:1514] Processing DeleteTablet for tablet c30e571d88a14bd98a8e271311cf2e85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:03 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:58910
I20260811 18:54:03.997049 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23436
I20260811 18:54:04.012670 24438 tablet_replica.cc:330] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: stopping tablet replica
I20260811 18:54:04.012956 24438 raft_consensus.cc:2229] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:04.013120 24437 tablet_replica.cc:330] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: stopping tablet replica
I20260811 18:54:04.013303 24437 raft_consensus.cc:2229] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:04.013412 24438 raft_consensus.cc:2258] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:04.013557 24437 raft_consensus.cc:2258] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:04.013995 24439 tablet_replica.cc:330] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: stopping tablet replica
I20260811 18:54:04.014191 24439 raft_consensus.cc:2229] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:04.014458 24439 raft_consensus.cc:2258] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:04.014791 24437 ts_tablet_manager.cc:1905] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:04.015719 24439 ts_tablet_manager.cc:1905] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:04.016136 24438 ts_tablet_manager.cc:1905] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:04.021657 24437 ts_tablet_manager.cc:1918] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:04.021821 24437 log.cc:1196] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/c30e571d88a14bd98a8e271311cf2e85
I20260811 18:54:04.022089 24438 ts_tablet_manager.cc:1918] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:04.022261 24437 ts_tablet_manager.cc:1939] T c30e571d88a14bd98a8e271311cf2e85 P d585bc12abf646f09c00a68005382d97: Deleting consensus metadata
I20260811 18:54:04.022279 24438 log.cc:1196] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/c30e571d88a14bd98a8e271311cf2e85
I20260811 18:54:04.022691 24438 ts_tablet_manager.cc:1939] T c30e571d88a14bd98a8e271311cf2e85 P f49e5ea799214cb2af7e2133ceebb3a5: Deleting consensus metadata
I20260811 18:54:04.022765 24439 ts_tablet_manager.cc:1918] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:54:04.022941 24439 log.cc:1196] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/c30e571d88a14bd98a8e271311cf2e85
I20260811 18:54:04.023443 24439 ts_tablet_manager.cc:1939] T c30e571d88a14bd98a8e271311cf2e85 P ab96185eb3654c76959ccd833d0bb1d2: Deleting consensus metadata
I20260811 18:54:04.023604 23263 catalog_manager.cc:4841] TS d585bc12abf646f09c00a68005382d97 (127.19.155.193:35335): tablet c30e571d88a14bd98a8e271311cf2e85 (table test-table [id=4e079f45da8849df89b647e7a3769d6e]) successfully deleted
I20260811 18:54:04.023908 23262 catalog_manager.cc:4841] TS f49e5ea799214cb2af7e2133ceebb3a5 (127.19.155.194:36399): tablet c30e571d88a14bd98a8e271311cf2e85 (table test-table [id=4e079f45da8849df89b647e7a3769d6e]) successfully deleted
I20260811 18:54:04.024479 23263 catalog_manager.cc:4841] TS ab96185eb3654c76959ccd833d0bb1d2 (127.19.155.195:44409): tablet c30e571d88a14bd98a8e271311cf2e85 (table test-table [id=4e079f45da8849df89b647e7a3769d6e]) successfully deleted
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:04.033317 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:03.999105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39980 (local address 127.19.155.193:35335)
0811 18:54:04.011847 (+ 12742us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:04.011858 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:04.011892 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:54:04.012139 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:04.012149 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:04.012261 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:04.012406 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:04.014306 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.015312 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.017266 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.017916 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.018034 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:04.027531 (+ 9497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:04.027548 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:04.027566 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:04.027599 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:04.030320 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.031070 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.031078 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.031081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.031209 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.031674 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.031682 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.031686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.032120 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:04.032404 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:04.032700 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 18:54:04.032917 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12550,"thread_start_us":12865,"threads_started":1}
W20260811 18:54:04.034041 23679 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39980
W20260811 18:54:04.034649 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23436: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:04.034857 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23436
I20260811 18:54:04.077478 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23692
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:04.093365 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:04.078306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58948 (local address 127.19.155.194:36399)
0811 18:54:04.078836 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:04.078841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:04.078859 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:54:04.078971 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:04.078975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:04.079051 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:04.079141 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:04.080384 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.081187 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.082372 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.082753 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.082849 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:04.087527 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:04.087542 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:04.087560 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:04.087597 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:04.090624 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.091361 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.091368 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.091371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.091502 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.091897 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.091901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.091903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.092290 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:04.092513 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:04.092792 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 18:54:04.092965 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":243,"threads_started":1}
W20260811 18:54:04.094064 23917 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58948
W20260811 18:54:04.094715 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23692: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:04.094888 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23692
I20260811 18:54:04.129612 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23931
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[23212](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:04.147850 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:04.130357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41886 (local address 127.19.155.195:44409)
0811 18:54:04.130959 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:04.130965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:04.130988 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:54:04.131053 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:04.131057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:04.131119 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:04.131219 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:04.132697 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.133431 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.134609 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:04.135173 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:04.135270 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:04.140598 (+ 5328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:04.140616 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:04.140635 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:04.140673 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:04.144479 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.145395 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.145405 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.145409 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.145592 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:04.146046 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:04.146053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:04.146057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:04.146594 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:04.146904 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:04.147400 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 18:54:04.147579 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":329,"threads_started":1}
W20260811 18:54:04.148561 24147 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41886
W20260811 18:54:04.149118 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23931: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:04.149271 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23931
I20260811 18:54:04.180708 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23239
I20260811 18:54:04.181914 23369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:04.298276 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23239
2026-08-11T18:54:04Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8640 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[24461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[24461](info): set up 2 sockets
Aug 11 18:54:04 dist-test-slave-1nl6 krb5kdc[24461](info): commencing operation
krb5kdc: starting...
W20260811 18:54:05.608165 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:05 dist-test-slave-1nl6 krb5kdc[24461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:05.818531 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38041
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:06.155167 24476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:06.155457 24476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:06.155550 24476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:06.162675 24476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:06.162779 24476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:06.162824 24476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:06.162881 24476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:06.162978 24476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:06.172704 24476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:06.174079 24476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:06.175401 24476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:06.187718 24485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:06.187757 24486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:06.187692 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:06.188305 24476 server_base.cc:1034] running on GCE node
I20260811 18:54:06.189221 24476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:06.190573 24476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:06.191807 24476 hybrid_clock.cc:648] HybridClock initialized: now 1786474446191746 us; error 52 us; skew 500 ppm
I20260811 18:54:06.192152 24476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:06 dist-test-slave-1nl6 krb5kdc[24461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474446, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:06.195221 24476 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:06.196709 24476 webserver.cc:460] Webserver started at http://127.19.155.254:40539/ using document root <none> and password file <none>
I20260811 18:54:06.197379 24476 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:06.197525 24476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:06.197849 24476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:06.200770 24476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "8ad9d8e8c44440ab9d28ebe409801c5f"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "98a916678a2d89bbadc7922527e7b0aa"
server_key_iv: "65bdaefee125e3bfd88eaadbd165b207"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.201545 24476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "8ad9d8e8c44440ab9d28ebe409801c5f"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "98a916678a2d89bbadc7922527e7b0aa"
server_key_iv: "65bdaefee125e3bfd88eaadbd165b207"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.206635 24476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 18:54:06.209926 24500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:06.211221 24476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:54:06.211421 24476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "8ad9d8e8c44440ab9d28ebe409801c5f"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "98a916678a2d89bbadc7922527e7b0aa"
server_key_iv: "65bdaefee125e3bfd88eaadbd165b207"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.211623 24476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:06.227777 24476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:06.231606 24476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:06.231896 24476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:06.249858 24476 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:38041
I20260811 18:54:06.249866 24592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:38041 every 8 connection(s)
I20260811 18:54:06.251350 24476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:06.255074 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:06.257493 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24476
I20260811 18:54:06.257750 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:06.258417 20079 external_mini_cluster.cc:1428] Setting key b2833c4da007a39187edb80f0dcd9a80
I20260811 18:54:06.268235 24593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f: Bootstrap starting.
I20260811 18:54:06.271869 24593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:06.272892 24593 log.cc:824] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:54:06 dist-test-slave-1nl6 krb5kdc[24461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:06.276149 24593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f: No bootstrap required, opened a new log
I20260811 18:54:06.283277 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:06.260561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50180 (local address 127.19.155.254:38041)
0811 18:54:06.261396 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:06.261412 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:06.261461 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:54:06.263811 (+ 2350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:06.263841 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:06.264423 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:06.264876 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:06.266227 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.268336 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.269680 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.270728 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.270949 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:06.275350 (+ 4401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:06.275363 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:06.275381 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:06.275425 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:06.278739 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:06.279457 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:06.279464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:06.279470 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:06.279666 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:06.280085 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:06.280093 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:06.280099 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:06.280928 (+ 829us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:06.281231 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:06.281757 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 18:54:06.282194 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":336,"threads_started":1}
I20260811 18:54:06.284812 24593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } }
I20260811 18:54:06.285189 24593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:06.285302 24593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ad9d8e8c44440ab9d28ebe409801c5f, State: Initialized, Role: FOLLOWER
I20260811 18:54:06.285916 24593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } }
I20260811 18:54:06.286207 24593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:06.286356 24593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:06.286513 24593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:06.288620 24593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } }
I20260811 18:54:06.289039 24593 leader_election.cc:302] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ad9d8e8c44440ab9d28ebe409801c5f; no voters:
I20260811 18:54:06.289610 24593 leader_election.cc:288] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:06.289662 24600 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:06.291029 24600 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [term 1 LEADER]: Becoming Leader. State: Replica: 8ad9d8e8c44440ab9d28ebe409801c5f, State: Running, Role: LEADER
I20260811 18:54:06.291501 24600 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } }
I20260811 18:54:06.291846 24593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:06.294497 24602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } } }
I20260811 18:54:06.294471 24603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ad9d8e8c44440ab9d28ebe409801c5f. Latest consensus state: current_term: 1 leader_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad9d8e8c44440ab9d28ebe409801c5f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38041 } } }
I20260811 18:54:06.294963 24602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:06.295032 24603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:06.300382 24608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:06.306047 24608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:06.314806 24608 catalog_manager.cc:1347] Generated new cluster ID: 4cda1d7a0f5d4829bf6c3a25345aa86d
I20260811 18:54:06.314949 24608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:06.348805 24608 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:06.350189 24608 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:06.361946 24608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ad9d8e8c44440ab9d28ebe409801c5f: Generated new TSK 0
I20260811 18:54:06.362807 24608 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:06.426424 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:06.772995 24639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:06.773331 24639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:06.773501 24639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:06.780874 24639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:06.781028 24639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:06.781199 24639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:06.790807 24639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:06.792295 24639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:06.793709 24639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:06.808176 24653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:06.808130 24655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:06.808300 24658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:06.809477 24639 server_base.cc:1034] running on GCE node
I20260811 18:54:06.810107 24639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:06.811021 24639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:06.812224 24639 hybrid_clock.cc:648] HybridClock initialized: now 1786474446812183 us; error 39 us; skew 500 ppm
I20260811 18:54:06.812531 24639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:06 dist-test-slave-1nl6 krb5kdc[24461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474446, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:06.815670 24639 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:06.817155 24639 webserver.cc:460] Webserver started at http://127.19.155.193:36291/ using document root <none> and password file <none>
I20260811 18:54:06.817845 24639 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:06.817983 24639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:06.818313 24639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:06.821269 24639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "4abc9408f8114d7b95791dd6a6088f46"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "7c9eb515bfbb935c494ae560b169acbc"
server_key_iv: "a876259ae02763481bda34c18233f4ed"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.822012 24639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "4abc9408f8114d7b95791dd6a6088f46"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "7c9eb515bfbb935c494ae560b169acbc"
server_key_iv: "a876259ae02763481bda34c18233f4ed"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.826964 24639 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 18:54:06.830358 24667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:06.831719 24639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:54:06.831918 24639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "4abc9408f8114d7b95791dd6a6088f46"
format_stamp: "Formatted at 2026-08-11 18:54:06 on dist-test-slave-1nl6"
server_key: "7c9eb515bfbb935c494ae560b169acbc"
server_key_iv: "a876259ae02763481bda34c18233f4ed"
server_key_version: "encryptionkey@0"
I20260811 18:54:06.832145 24639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:06.853168 24639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:06.857151 24639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:06.857468 24639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:06.858438 24639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:06.859824 24639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:06.859934 24639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:06.860082 24639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:06.860154 24639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:06.893618 24639 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40021
I20260811 18:54:06.893678 24870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40021 every 8 connection(s)
I20260811 18:54:06.894948 24639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:06.899998 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24639
I20260811 18:54:06.900321 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:06.900971 20079 external_mini_cluster.cc:1428] Setting key 56b49f3f9591b9766360cf4a9b438696
Aug 11 18:54:06 dist-test-slave-1nl6 krb5kdc[24461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474446, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:06.914706 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:06.897495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:45929 (local address 127.19.155.254:38041)
0811 18:54:06.897954 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:06.897959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:06.898854 (+ 895us) server_negotiation.cc:407] Connection header received
0811 18:54:06.901022 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:06.901028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:06.901137 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:06.901301 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:06.902863 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.903637 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.905178 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.905591 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.905725 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:06.909089 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:06.909094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:06.909097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:06.909128 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:06.911676 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:06.912406 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:06.912416 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:06.912419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:06.912538 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:06.912961 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:06.912966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:06.912970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:06.913252 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:06.913410 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:06.914100 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 18:54:06.914332 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":245,"threads_started":1}
I20260811 18:54:06.915769 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:06.897961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38041 (local address 127.19.155.193:45929)
0811 18:54:06.898679 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:06.898733 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:06.900709 (+ 1976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:06.901572 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:06.901581 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:06.902111 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:06.902675 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:06.902692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.903809 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.903813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:06.905023 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:06.905035 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:06.905838 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:06.905845 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:06.906057 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:06.906748 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:06.906775 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:06.908880 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:06.911826 (+ 2946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:06.911835 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:06.911850 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:06.912279 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:06.912652 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:06.912657 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:06.912661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:06.912846 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:06.913384 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:06.913392 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:06.913714 (+ 322us) client_negotiation.cc:769] Sending connection context
0811 18:54:06.913995 (+ 281us) client_negotiation.cc:240] Negotiation successful
0811 18:54:06.914504 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":288,"threads_started":1}
I20260811 18:54:06.917373 24876 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38041
I20260811 18:54:06.917724 24876 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:06.918697 24876 heartbeater.cc:511] Master 127.19.155.254:38041 requested a full tablet report, sending...
I20260811 18:54:06.921461 24526 ts_manager.cc:194] Registered new tserver with Master: 4abc9408f8114d7b95791dd6a6088f46 (127.19.155.193:40021)
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:54:06.923760 24526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:45929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:06.950534 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:07.283109 24887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:07.283387 24887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:07.283483 24887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:07.290490 24887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:07.290591 24887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:07.290699 24887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:07.300387 24887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:07.301707 24887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:07.303046 24887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:07.316128 24896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:07.316080 24903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:07.316162 24897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:07.316890 24887 server_base.cc:1034] running on GCE node
I20260811 18:54:07.317485 24887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:07.318353 24887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:07.319579 24887 hybrid_clock.cc:648] HybridClock initialized: now 1786474447319538 us; error 52 us; skew 500 ppm
I20260811 18:54:07.319891 24887 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:07 dist-test-slave-1nl6 krb5kdc[24461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:07.323092 24887 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:07.324481 24887 webserver.cc:460] Webserver started at http://127.19.155.194:39755/ using document root <none> and password file <none>
I20260811 18:54:07.325146 24887 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:07.325299 24887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:07.325595 24887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:07.328624 24887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "cd734d60bd614c7bb117c5ca0119b58e"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "e0173e8a3830ed05bbef434f727ad25a"
server_key_iv: "40d53a7fe7061eef861675d799669f43"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.329646 24887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "cd734d60bd614c7bb117c5ca0119b58e"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "e0173e8a3830ed05bbef434f727ad25a"
server_key_iv: "40d53a7fe7061eef861675d799669f43"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.334693 24887 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:54:07.338287 24912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.339725 24887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:07.339901 24887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "cd734d60bd614c7bb117c5ca0119b58e"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "e0173e8a3830ed05bbef434f727ad25a"
server_key_iv: "40d53a7fe7061eef861675d799669f43"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.340087 24887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:07.357736 24887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:07.362411 24887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:07.362645 24887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:07.363574 24887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:07.364861 24887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:07.364933 24887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.365016 24887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:07.365059 24887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.398428 24887 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:42975
I20260811 18:54:07.398470 25094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:42975 every 8 connection(s)
I20260811 18:54:07.400098 24887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:07.400831 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24887
I20260811 18:54:07.401032 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:07.401612 20079 external_mini_cluster.cc:1428] Setting key ca3d14a0121ac72f91c569655850f870
Aug 11 18:54:07 dist-test-slave-1nl6 krb5kdc[24461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:07.424666 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:07.403010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:50327 (local address 127.19.155.254:38041)
0811 18:54:07.403187 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:07.403192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:07.407552 (+ 4360us) server_negotiation.cc:407] Connection header received
0811 18:54:07.409349 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:07.409354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:07.409441 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:07.409560 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:07.411099 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.411850 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.413388 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.413820 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.413983 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:07.417848 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:07.417857 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:07.417865 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:07.417913 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:07.421592 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:07.422297 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:07.422308 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:07.422310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:07.422437 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:07.422874 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:07.422879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:07.422887 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:07.423225 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:07.423385 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:07.424041 (+ 656us) server_negotiation.cc:299] Negotiation successful
0811 18:54:07.424309 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:54:07.425623 25098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:07.403690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38041 (local address 127.19.155.194:50327)
0811 18:54:07.407400 (+ 3710us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:07.407438 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:07.409068 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:07.409805 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:07.409813 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:07.410345 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:07.410936 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:07.410965 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.412006 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.412012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:07.413228 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:07.413241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.414103 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.414111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:07.414333 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:07.415083 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:07.415109 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:07.417587 (+ 2478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:07.421729 (+ 4142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:07.421736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:07.421748 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:07.422151 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:07.422551 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:07.422556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:07.422560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:07.422749 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:07.423358 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:07.423366 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:07.423687 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 18:54:07.423947 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 18:54:07.424507 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3454,"thread_start_us":3273,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
I20260811 18:54:07.427103 25096 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38041
I20260811 18:54:07.427412 25096 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:07.428108 25096 heartbeater.cc:511] Master 127.19.155.254:38041 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
I20260811 18:54:07.429677 24526 ts_manager.cc:194] Registered new tserver with Master: cd734d60bd614c7bb117c5ca0119b58e (127.19.155.194:42975)
I20260811 18:54:07.430480 24526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:50327
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:07.454339 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:07.785641 25103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:07.785908 25103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:07.786054 25103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:07.793174 25103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:07.793274 25103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:07.793478 25103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:07.802891 25103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:07.804195 25103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:07.805493 25103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:07.818717 25112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:07.818624 25114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:07.818811 25116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:07.820034 25103 server_base.cc:1034] running on GCE node
I20260811 18:54:07.820688 25103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:07.821635 25103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:07.822875 25103 hybrid_clock.cc:648] HybridClock initialized: now 1786474447822833 us; error 53 us; skew 500 ppm
I20260811 18:54:07.823259 25103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:07 dist-test-slave-1nl6 krb5kdc[24461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:07.826399 25103 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:07.827931 25103 webserver.cc:460] Webserver started at http://127.19.155.195:41643/ using document root <none> and password file <none>
I20260811 18:54:07.828599 25103 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:07.828704 25103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:07.828967 25103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:07.831909 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "0800b7c1381b4046a446a1e4435cdb9a"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "417c886946239d8009c837134ab5b95e"
server_key_iv: "b6dab0c92617fc184e4475b3593176ba"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.832703 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "0800b7c1381b4046a446a1e4435cdb9a"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "417c886946239d8009c837134ab5b95e"
server_key_iv: "b6dab0c92617fc184e4475b3593176ba"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.837815 25103 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:07.841327 25130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.842615 25103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:07.842761 25103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "0800b7c1381b4046a446a1e4435cdb9a"
format_stamp: "Formatted at 2026-08-11 18:54:07 on dist-test-slave-1nl6"
server_key: "417c886946239d8009c837134ab5b95e"
server_key_iv: "b6dab0c92617fc184e4475b3593176ba"
server_key_version: "encryptionkey@0"
I20260811 18:54:07.842978 25103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:07.859125 25103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:07.862948 25103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:07.863191 25103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:07.864039 25103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:07.865284 25103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:07.865355 25103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.865440 25103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:07.865494 25103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:07.900316 25103 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:42855
I20260811 18:54:07.900396 25317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:42855 every 8 connection(s)
I20260811 18:54:07.901614 25103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:07.903999 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25103
I20260811 18:54:07.904202 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:07.904745 20079 external_mini_cluster.cc:1428] Setting key 6b56a2436c09b7aa23e21d39609f9374
Aug 11 18:54:07 dist-test-slave-1nl6 krb5kdc[24461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474447, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:07.921933 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:07.904238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:45501 (local address 127.19.155.254:38041)
0811 18:54:07.904421 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:07.904425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:07.905970 (+ 1545us) server_negotiation.cc:407] Connection header received
0811 18:54:07.908347 (+ 2377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:07.908351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:07.908417 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:07.908497 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:07.909974 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.910788 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.912382 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.912811 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.912910 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:07.916305 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:07.916310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:07.916313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:07.916346 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:07.918751 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:07.919691 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:07.919699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:07.919703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:07.919883 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:07.920433 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:07.920438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:07.920442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:07.920729 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:07.920850 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:07.921524 (+ 674us) server_negotiation.cc:299] Negotiation successful
0811 18:54:07.921682 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:54:07.922925 25320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:07.904871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38041 (local address 127.19.155.195:45501)
0811 18:54:07.905790 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:07.905826 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:07.908108 (+ 2282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:07.908747 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:07.908755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:07.909252 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:07.909814 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:07.909832 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.911007 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.911011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:07.912246 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:07.912259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:07.912994 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:07.912999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:07.913187 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:07.913813 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:07.913834 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:07.916118 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:07.918888 (+ 2770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:07.918929 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:07.918944 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:07.919555 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:07.920012 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:07.920016 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:07.920018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:07.920298 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:07.920854 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:07.920859 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:07.921189 (+ 330us) client_negotiation.cc:769] Sending connection context
0811 18:54:07.921427 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 18:54:07.921789 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":380,"threads_started":1}
I20260811 18:54:07.924288 25318 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38041
I20260811 18:54:07.924595 25318 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:07.925324 25318 heartbeater.cc:511] Master 127.19.155.254:38041 requested a full tablet report, sending...
I20260811 18:54:07.926836 24526 ts_manager.cc:194] Registered new tserver with Master: 0800b7c1381b4046a446a1e4435cdb9a (127.19.155.195:42855)
I20260811 18:54:07.926815 24876 heartbeater.cc:503] Master 127.19.155.254:38041 was elected leader, sending a full tablet report...
I20260811 18:54:07.927843 24526 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:45501
I20260811 18:54:07.932440 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:54:07.968531 24879 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:07.966092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54402 (local address 127.19.155.254:38041)
0811 18:54:07.966272 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:07.966276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:07.966739 (+ 463us) server_negotiation.cc:407] Connection header received
0811 18:54:07.966894 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:07.966937 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:07.967010 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:07.967123 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:07.968328 (+ 1205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54402: BlockingRecv error: recv got EOF from 127.0.0.1:54402 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:54:07.971738 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24639
W20260811 18:54:07.974397 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24639: Not authorized: Client connection negotiation failed: client connection to 127.19.155.193:40021: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:54:07.974596 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24639
I20260811 18:54:07.997869 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24887
W20260811 18:54:08.001349 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24887: Not authorized: Client connection negotiation failed: client connection to 127.19.155.194:42975: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:54:08.001538 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24887
I20260811 18:54:08.027328 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25103
W20260811 18:54:08.030469 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25103: Not authorized: Client connection negotiation failed: client connection to 127.19.155.195:42855: server requires authentication, but client does not have Kerberos credentials available
I20260811 18:54:08.030604 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25103
I20260811 18:54:08.055073 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24476
I20260811 18:54:08.056360 24583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:08.164203 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24476
2026-08-11T18:54:08Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3860 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:08 dist-test-slave-1nl6 krb5kdc[25350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:08 dist-test-slave-1nl6 krb5kdc[25350](info): set up 2 sockets
Aug 11 18:54:08 dist-test-slave-1nl6 krb5kdc[25350](info): commencing operation
krb5kdc: starting...
W20260811 18:54:09.482882 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:09 dist-test-slave-1nl6 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:09.693908 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34053
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:33761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:10.024513 25376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:10.024806 25376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:10.025005 25376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:10.032265 25376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:10.032397 25376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:10.032505 25376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:10.032601 25376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:10.032696 25376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:10.042429 25376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:10.043798 25376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:10.045238 25376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:10.057118 25387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:10.057241 25384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:10.057209 25393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:10.058276 25376 server_base.cc:1034] running on GCE node
I20260811 18:54:10.059130 25376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:10.060496 25376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:10.061702 25376 hybrid_clock.cc:648] HybridClock initialized: now 1786474450061656 us; error 38 us; skew 500 ppm
I20260811 18:54:10.062062 25376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:10 dist-test-slave-1nl6 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474450, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:10.068070 25376 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:10.069554 25376 webserver.cc:460] Webserver started at http://127.19.155.254:41895/ using document root <none> and password file <none>
I20260811 18:54:10.070267 25376 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:10.070421 25376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:10.070760 25376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:10.073828 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "78a352670992448099290083facdd3d2"
format_stamp: "Formatted at 2026-08-11 18:54:10 on dist-test-slave-1nl6"
server_key: "acdc00abb7884eea55ab1321a3570da5"
server_key_iv: "8f93b890f2c8a90469e7aa58c1a449eb"
server_key_version: "encryptionkey@0"
I20260811 18:54:10.074647 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "78a352670992448099290083facdd3d2"
format_stamp: "Formatted at 2026-08-11 18:54:10 on dist-test-slave-1nl6"
server_key: "acdc00abb7884eea55ab1321a3570da5"
server_key_iv: "8f93b890f2c8a90469e7aa58c1a449eb"
server_key_version: "encryptionkey@0"
I20260811 18:54:10.079828 25376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 18:54:10.083247 25403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:10.084549 25376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:54:10.084694 25376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "78a352670992448099290083facdd3d2"
format_stamp: "Formatted at 2026-08-11 18:54:10 on dist-test-slave-1nl6"
server_key: "acdc00abb7884eea55ab1321a3570da5"
server_key_iv: "8f93b890f2c8a90469e7aa58c1a449eb"
server_key_version: "encryptionkey@0"
I20260811 18:54:10.084861 25376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:10.111497 25376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:10.115602 25376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:10.115857 25376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:10.134514 25376 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34053
I20260811 18:54:10.134534 25491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34053 every 8 connection(s)
I20260811 18:54:10.135985 25376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:10.140705 25492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:10.144812 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25376
I20260811 18:54:10.145038 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:10.145974 20079 external_mini_cluster.cc:1428] Setting key 86f62a819da264c07f81390b897d278f
I20260811 18:54:10.157702 25492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: Bootstrap starting.
I20260811 18:54:10.161792 25492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:10.163236 25492 log.cc:824] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:54:10 dist-test-slave-1nl6 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:10.166285 25492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: No bootstrap required, opened a new log
I20260811 18:54:10.172873 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:10.148766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.19.155.254:34053)
0811 18:54:10.150103 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:10.150118 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:10.150196 (+ 78us) server_negotiation.cc:407] Connection header received
0811 18:54:10.153027 (+ 2831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:10.153059 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:10.153683 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:10.154129 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:10.156106 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:10.157451 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:10.159296 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:10.159950 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:10.160086 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:10.165260 (+ 5174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:10.165268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:10.165282 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:10.165314 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:10.168421 (+ 3107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:10.169258 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:10.169265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:10.169270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:10.169442 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:10.169907 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:10.169911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:10.169913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:10.170528 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:10.170792 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:10.171405 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 18:54:10.171845 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1073,"thread_start_us":842,"threads_started":1}
I20260811 18:54:10.175539 25492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } }
I20260811 18:54:10.175915 25492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:10.176046 25492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a352670992448099290083facdd3d2, State: Initialized, Role: FOLLOWER
I20260811 18:54:10.176672 25492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } }
I20260811 18:54:10.176961 25492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:10.177102 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:54:10.177120 25492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:10.177279 25492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:10.179515 25492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } }
I20260811 18:54:10.180015 25492 leader_election.cc:302] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78a352670992448099290083facdd3d2; no voters:
I20260811 18:54:10.180619 25492 leader_election.cc:288] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:10.180758 25498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:10.182613 25492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:10.187668 25498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [term 1 LEADER]: Becoming Leader. State: Replica: 78a352670992448099290083facdd3d2, State: Running, Role: LEADER
I20260811 18:54:10.188271 25498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } }
I20260811 18:54:10.194298 25499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78a352670992448099290083facdd3d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } } }
I20260811 18:54:10.194432 25500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78a352670992448099290083facdd3d2. Latest consensus state: current_term: 1 leader_uuid: "78a352670992448099290083facdd3d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78a352670992448099290083facdd3d2" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34053 } } }
I20260811 18:54:10.194725 25499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:10.194716 25500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2 [sys.catalog]: This master's current role is: LEADER
W20260811 18:54:10.200945 25526 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:54:10.201144 25526 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:54:10.203464 25528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:10.205094 25528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:10.213079 25528 catalog_manager.cc:1347] Generated new cluster ID: a4fd74daa7e84c7b9ff652fe08e495a3
I20260811 18:54:10.213191 25528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:10.231376 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:10.222089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.19.155.254:34053)
0811 18:54:10.222266 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:10.222272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:10.223062 (+ 790us) server_negotiation.cc:407] Connection header received
0811 18:54:10.223237 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:10.223249 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:10.223340 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:10.223459 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:10.224584 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:10.225731 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:10.227549 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:10.228231 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:10.228370 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:10.229546 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:10.229554 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:10.229560 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:10.230406 (+ 846us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:10.230497 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:10.230533 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:10.230648 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:10.230870 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:54:10.231012 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:54:10.232822 25528 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:10.234018 25528 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:10.243355 25528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78a352670992448099290083facdd3d2: Generated new TSK 0
I20260811 18:54:10.244455 25528 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:54:10.254443 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25376
I20260811 18:54:10.255611 25479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:10.342613 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25376
2026-08-11T18:54:10Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2174 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:10 dist-test-slave-1nl6 krb5kdc[25551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:10 dist-test-slave-1nl6 krb5kdc[25551](info): set up 2 sockets
Aug 11 18:54:10 dist-test-slave-1nl6 krb5kdc[25551](info): commencing operation
krb5kdc: starting...
W20260811 18:54:11.650704 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.002s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:11 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:11.862334 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46435
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46435
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:12.203011 25571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:12.203325 25571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:12.203491 25571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:12.210714 25571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:12.210822 25571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:12.210878 25571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:12.210992 25571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:12.211053 25571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:12.220990 25571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:12.222337 25571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:12.223738 25571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:12.235657 25579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:12.235747 25578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:12.235747 25582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:12.236698 25571 server_base.cc:1034] running on GCE node
I20260811 18:54:12.237453 25571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:12.238708 25571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:12.239934 25571 hybrid_clock.cc:648] HybridClock initialized: now 1786474452239897 us; error 52 us; skew 500 ppm
I20260811 18:54:12.240279 25571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:12 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:12.243537 25571 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:12.244983 25571 webserver.cc:460] Webserver started at http://127.19.155.254:45145/ using document root <none> and password file <none>
I20260811 18:54:12.245630 25571 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:12.245782 25571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:12.246094 25571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:12.249023 25571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "db3cb88192704cca813e29bc01451aaa"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "59ca5e778ae3f097c5619d84f2b96837"
server_key_iv: "9752b6cbd3607301696d15a2833417e5"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.249850 25571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "db3cb88192704cca813e29bc01451aaa"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "59ca5e778ae3f097c5619d84f2b96837"
server_key_iv: "9752b6cbd3607301696d15a2833417e5"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.254772 25571 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:12.258040 25595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:12.259265 25571 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 18:54:12.259442 25571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "db3cb88192704cca813e29bc01451aaa"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "59ca5e778ae3f097c5619d84f2b96837"
server_key_iv: "9752b6cbd3607301696d15a2833417e5"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.259632 25571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:12.273029 25571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:12.276895 25571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:12.277199 25571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:12.295454 25571 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46435
I20260811 18:54:12.295495 25669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46435 every 8 connection(s)
I20260811 18:54:12.296797 25571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:12.300575 25671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:12.301000 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25571
I20260811 18:54:12.301242 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:12.302119 20079 external_mini_cluster.cc:1428] Setting key 73e0745da0c9dabdef4bb7aed893421d
I20260811 18:54:12.313426 25671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa: Bootstrap starting.
Aug 11 18:54:12 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:12.316715 25671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:12.317731 25671 log.cc:824] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:12.320719 25671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa: No bootstrap required, opened a new log
I20260811 18:54:12.324559 25674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:12.304382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39530 (local address 127.19.155.254:46435)
0811 18:54:12.305779 (+ 1397us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:12.305795 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:12.305841 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:54:12.307523 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:12.307545 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:12.307947 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:12.308326 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:12.309739 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.311101 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.312343 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.312985 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.313200 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:12.317420 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:12.317428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:12.317441 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:12.317480 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:12.320533 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:12.321290 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:12.321298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:12.321313 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:12.321472 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:12.321866 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:12.321871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:12.321876 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:12.322393 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:12.322748 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:12.323187 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 18:54:12.323606 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1176,"thread_start_us":975,"threads_started":1}
I20260811 18:54:12.328497 25671 raft_consensus.cc:348] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } }
I20260811 18:54:12.328853 25671 raft_consensus.cc:374] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:12.328964 25671 raft_consensus.cc:729] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db3cb88192704cca813e29bc01451aaa, State: Initialized, Role: FOLLOWER
I20260811 18:54:12.329494 25671 consensus_queue.cc:260] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } }
I20260811 18:54:12.329725 25671 raft_consensus.cc:388] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:12.329873 25671 raft_consensus.cc:482] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:12.330042 25671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:12.332199 25671 raft_consensus.cc:504] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } }
I20260811 18:54:12.332669 25671 leader_election.cc:302] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db3cb88192704cca813e29bc01451aaa; no voters:
I20260811 18:54:12.333192 25671 leader_election.cc:288] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:12.333328 25676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:12.334399 25676 raft_consensus.cc:686] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [term 1 LEADER]: Becoming Leader. State: Replica: db3cb88192704cca813e29bc01451aaa, State: Running, Role: LEADER
I20260811 18:54:12.335161 25676 consensus_queue.cc:237] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } }
I20260811 18:54:12.335278 25671 sys_catalog.cc:564] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:12.338373 25678 sys_catalog.cc:455] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader db3cb88192704cca813e29bc01451aaa. Latest consensus state: current_term: 1 leader_uuid: "db3cb88192704cca813e29bc01451aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } } }
I20260811 18:54:12.338320 25677 sys_catalog.cc:455] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db3cb88192704cca813e29bc01451aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db3cb88192704cca813e29bc01451aaa" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46435 } } }
I20260811 18:54:12.338708 25678 sys_catalog.cc:458] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:12.338764 25677 sys_catalog.cc:458] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:12.340432 25692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:12.345806 25692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:12.356024 25692 catalog_manager.cc:1347] Generated new cluster ID: 132d902f69d64492bccbb58f6669735c
I20260811 18:54:12.356133 25692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:12.388299 25692 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:12.390182 25692 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:12.397022 25692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db3cb88192704cca813e29bc01451aaa: Generated new TSK 0
I20260811 18:54:12.397948 25692 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:12.453729 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:12.783084 25709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:12.783350 25709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:12.783507 25709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:12.790561 25709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:12.790669 25709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:12.790890 25709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:12.800411 25709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:12.801726 25709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:12.803076 25709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:12.816361 25724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:12.816319 25729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:12.816373 25725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:12.817266 25709 server_base.cc:1034] running on GCE node
I20260811 18:54:12.817862 25709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:12.818701 25709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:12.819897 25709 hybrid_clock.cc:648] HybridClock initialized: now 1786474452819844 us; error 58 us; skew 500 ppm
I20260811 18:54:12.820196 25709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:12 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:12.823309 25709 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:12.825011 25709 webserver.cc:460] Webserver started at http://127.19.155.193:46853/ using document root <none> and password file <none>
I20260811 18:54:12.825654 25709 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:12.825826 25709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:12.826136 25709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:12.828860 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "c0cebd71ebbd492dba3f9dc5d1d2b03f"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "a673a21b708f53feabd23b96c3c0951f"
server_key_iv: "43591c97853f98990ee7fac8f02d3722"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.829604 25709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "c0cebd71ebbd492dba3f9dc5d1d2b03f"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "a673a21b708f53feabd23b96c3c0951f"
server_key_iv: "43591c97853f98990ee7fac8f02d3722"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.834578 25709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 18:54:12.837821 25745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:12.838967 25709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260811 18:54:12.839145 25709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "c0cebd71ebbd492dba3f9dc5d1d2b03f"
format_stamp: "Formatted at 2026-08-11 18:54:12 on dist-test-slave-1nl6"
server_key: "a673a21b708f53feabd23b96c3c0951f"
server_key_iv: "43591c97853f98990ee7fac8f02d3722"
server_key_version: "encryptionkey@0"
I20260811 18:54:12.839344 25709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:12.850559 25709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:12.854205 25709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:12.854482 25709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:12.855407 25709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:12.856657 25709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:12.856762 25709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:12.856909 25709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:12.856983 25709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:12.889432 25709 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40511
I20260811 18:54:12.889478 25919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40511 every 8 connection(s)
I20260811 18:54:12.890645 25709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:12.893441 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25709
I20260811 18:54:12.893656 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:12.894381 20079 external_mini_cluster.cc:1428] Setting key 8c5988315aa579d481f811bce9eabf35
Aug 11 18:54:12 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474452, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:12.912110 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:12.893235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:50131 (local address 127.19.155.254:46435)
0811 18:54:12.893771 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:12.893778 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:12.894825 (+ 1047us) server_negotiation.cc:407] Connection header received
0811 18:54:12.896979 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:12.896985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:12.897074 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:12.897186 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:12.898642 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.899442 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.900966 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.901390 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.901532 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:12.904946 (+ 3414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:12.904955 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:12.904963 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:12.905010 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:12.908550 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:12.909504 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:12.909512 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:12.909517 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:12.909692 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:12.910122 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:12.910129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:12.910135 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:12.910490 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:12.910640 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:12.911371 (+ 731us) server_negotiation.cc:299] Negotiation successful
0811 18:54:12.911620 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":251,"threads_started":1}
I20260811 18:54:12.912632 25930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:12.893787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46435 (local address 127.19.155.193:50131)
0811 18:54:12.894631 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:12.894686 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:12.896678 (+ 1992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:12.897432 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:12.897440 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:12.897933 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:12.898475 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:12.898492 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.899598 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.899603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:12.900813 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:12.900833 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:12.901610 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:12.901618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:12.901846 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:12.902524 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:12.902545 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:12.904734 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:12.908772 (+ 4038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:12.908779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:12.908790 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:12.909171 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:12.909832 (+ 661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:12.909836 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:12.909838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:12.910001 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:12.910609 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:12.910614 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:12.910958 (+ 344us) client_negotiation.cc:769] Sending connection context
0811 18:54:12.911193 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 18:54:12.911552 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":373,"threads_started":1}
I20260811 18:54:12.914297 25924 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46435
I20260811 18:54:12.914655 25924 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:12.915639 25924 heartbeater.cc:511] Master 127.19.155.254:46435 requested a full tablet report, sending...
I20260811 18:54:12.917894 25620 ts_manager.cc:194] Registered new tserver with Master: c0cebd71ebbd492dba3f9dc5d1d2b03f (127.19.155.193:40511)
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:54:12.919430 25620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:50131
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:12.945478 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:13.280682 25935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:13.281153 25935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:13.281283 25935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:13.288584 25935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:13.288697 25935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:13.288816 25935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:13.301138 25935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:13.302635 25935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:13.304319 25935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:13.319114 25945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:13.319154 25949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:13.319221 25943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:13.320114 25935 server_base.cc:1034] running on GCE node
I20260811 18:54:13.320690 25935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:13.321574 25935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:13.322790 25935 hybrid_clock.cc:648] HybridClock initialized: now 1786474453322754 us; error 45 us; skew 500 ppm
I20260811 18:54:13.323179 25935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:13 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:13.326195 25935 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:13.327674 25935 webserver.cc:460] Webserver started at http://127.19.155.194:40347/ using document root <none> and password file <none>
I20260811 18:54:13.328336 25935 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:13.328487 25935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:13.328799 25935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:13.331668 25935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "cb18b0d9147946b0a9d6e1fb117d125f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "c04df3b00355ba91e240b632c548eb35"
server_key_iv: "1eca0697452de6f58dbee15625ca3042"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.332473 25935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "cb18b0d9147946b0a9d6e1fb117d125f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "c04df3b00355ba91e240b632c548eb35"
server_key_iv: "1eca0697452de6f58dbee15625ca3042"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.337356 25935 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:54:13.340749 25964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.342078 25935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 18:54:13.342257 25935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "cb18b0d9147946b0a9d6e1fb117d125f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "c04df3b00355ba91e240b632c548eb35"
server_key_iv: "1eca0697452de6f58dbee15625ca3042"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.342454 25935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:13.361898 25935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:13.366403 25935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:13.366729 25935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:13.367822 25935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:13.369252 25935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:13.369359 25935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.369510 25935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:13.369585 25935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.404934 25935 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:40177
I20260811 18:54:13.404978 26155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:40177 every 8 connection(s)
I20260811 18:54:13.406330 25935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:13.416469 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25935
I20260811 18:54:13.416652 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:13.417143 20079 external_mini_cluster.cc:1428] Setting key ea67d99a297f90bbc86a9c18ef62c11f
Aug 11 18:54:13 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:13.428105 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:13.409084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:35793 (local address 127.19.155.254:46435)
0811 18:54:13.409356 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:13.409363 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:13.410802 (+ 1439us) server_negotiation.cc:407] Connection header received
0811 18:54:13.412788 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:13.412793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:13.412869 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:13.412965 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:13.414663 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.415475 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.417202 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.417722 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.417865 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:13.422099 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:13.422104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:13.422107 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:13.422142 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:13.424881 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:13.425628 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:13.425661 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:13.425664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:13.425796 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:13.426250 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:13.426255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:13.426258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:13.426542 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:13.426707 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:13.427511 (+ 804us) server_negotiation.cc:299] Negotiation successful
0811 18:54:13.427745 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 18:54:13.429143 26162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:13.409704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46435 (local address 127.19.155.194:35793)
0811 18:54:13.410606 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:13.410653 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:13.412504 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:13.413274 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:13.413289 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:13.413893 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:13.414486 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:13.414505 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.415616 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.415619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:13.417041 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:13.417054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.418029 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.418038 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:13.418345 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:13.419154 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:13.419185 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:13.421835 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:13.425033 (+ 3198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:13.425043 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:13.425061 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:13.425501 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:13.425920 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:13.425926 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:13.425929 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:13.426131 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:13.426680 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:13.426688 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:13.427141 (+ 453us) client_negotiation.cc:769] Sending connection context
0811 18:54:13.427425 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 18:54:13.428004 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":424,"threads_started":1}
I20260811 18:54:13.430649 26158 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46435
I20260811 18:54:13.431042 26158 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:13.431972 26158 heartbeater.cc:511] Master 127.19.155.254:46435 requested a full tablet report, sending...
I20260811 18:54:13.433727 25620 ts_manager.cc:194] Registered new tserver with Master: cb18b0d9147946b0a9d6e1fb117d125f (127.19.155.194:40177)
I20260811 18:54:13.435060 25620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:35793
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:13.468468 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:13.803284 26167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:13.803547 26167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:13.803745 26167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:13.810729 26167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:13.810827 26167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:13.811065 26167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:13.820425 26167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:13.821661 26167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:13.823055 26167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:13.836704 26177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:13.836835 26174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:13.836858 26180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:13.837350 26167 server_base.cc:1034] running on GCE node
I20260811 18:54:13.837960 26167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:13.838781 26167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:13.839972 26167 hybrid_clock.cc:648] HybridClock initialized: now 1786474453839910 us; error 52 us; skew 500 ppm
I20260811 18:54:13.840324 26167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:13 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:13.843555 26167 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:13.844957 26167 webserver.cc:460] Webserver started at http://127.19.155.195:44513/ using document root <none> and password file <none>
I20260811 18:54:13.845659 26167 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:13.845811 26167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:13.846148 26167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:13.849130 26167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "50f921f53e464111b566d55c3b878a1f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "92fbf779d5bd9e2716d905a43a7d3577"
server_key_iv: "a292de580cf9745a677497fd388b7aa7"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.849920 26167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "50f921f53e464111b566d55c3b878a1f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "92fbf779d5bd9e2716d905a43a7d3577"
server_key_iv: "a292de580cf9745a677497fd388b7aa7"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.854967 26167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:54:13.858083 26191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.859297 26167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260811 18:54:13.859453 26167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "50f921f53e464111b566d55c3b878a1f"
format_stamp: "Formatted at 2026-08-11 18:54:13 on dist-test-slave-1nl6"
server_key: "92fbf779d5bd9e2716d905a43a7d3577"
server_key_iv: "a292de580cf9745a677497fd388b7aa7"
server_key_version: "encryptionkey@0"
I20260811 18:54:13.859627 26167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:13.879635 26167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:13.883428 26167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:13.883720 26167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:13.884672 26167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:13.885980 26167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:13.886085 26167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.886237 26167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:13.886310 26167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:13.920857 26167 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:37429
I20260811 18:54:13.920884 26381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:37429 every 8 connection(s)
I20260811 18:54:13.922205 26167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:13.922433 25924 heartbeater.cc:503] Master 127.19.155.254:46435 was elected leader, sending a full tablet report...
I20260811 18:54:13.931236 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 26167
I20260811 18:54:13.931417 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:13.931876 20079 external_mini_cluster.cc:1428] Setting key b8d1dd53ff97b40d3cf32f8e10571f5d
Aug 11 18:54:13 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:13.942401 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:13.925268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:42371 (local address 127.19.155.254:46435)
0811 18:54:13.925475 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:13.925480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:13.926592 (+ 1112us) server_negotiation.cc:407] Connection header received
0811 18:54:13.928448 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:13.928452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:13.928514 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:13.928597 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:13.930086 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.930971 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.932791 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.933295 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.933447 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:13.937052 (+ 3605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:13.937057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:13.937061 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:13.937092 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:13.939708 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:13.940348 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:13.940359 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:13.940362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:13.940485 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:13.940868 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:13.940871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:13.940873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:13.941129 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:13.941239 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:13.941954 (+ 715us) server_negotiation.cc:299] Negotiation successful
0811 18:54:13.942143 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 18:54:13.943511 26389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:13.925732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46435 (local address 127.19.155.195:42371)
0811 18:54:13.926436 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:13.926480 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:13.928147 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:13.928815 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:13.928823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:13.929354 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:13.929909 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:13.929927 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.931130 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.931133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:13.932632 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:13.932651 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:13.933519 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:13.933524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:13.933796 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:13.934472 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:13.934496 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:13.936878 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:13.939828 (+ 2950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:13.939835 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:13.939846 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:13.940245 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:13.940583 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:13.940586 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:13.940589 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:13.940772 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:13.941233 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:13.941238 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:13.941590 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 18:54:13.941834 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 18:54:13.942289 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":279,"threads_started":1}
I20260811 18:54:13.944960 26386 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46435
I20260811 18:54:13.945289 26386 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:13.946316 26386 heartbeater.cc:511] Master 127.19.155.254:46435 requested a full tablet report, sending...
I20260811 18:54:13.947898 25620 ts_manager.cc:194] Registered new tserver with Master: 50f921f53e464111b566d55c3b878a1f (127.19.155.195:37429)
I20260811 18:54:13.948696 25620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:42371
I20260811 18:54:13.959565 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:54:13 dist-test-slave-1nl6 krb5kdc[25551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:14.014294 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:13.999356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.19.155.254:46435)
0811 18:54:13.999597 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:13.999606 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:14.000049 (+ 443us) server_negotiation.cc:407] Connection header received
0811 18:54:14.000282 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:14.000287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:14.000356 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:14.000470 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:14.001946 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.002721 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.004078 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.004521 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.004663 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:14.008673 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:14.008679 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:14.008682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:14.008718 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:14.011562 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.012273 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.012278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.012280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.012419 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.012811 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.012816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.012821 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.013164 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:14.013431 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:14.013735 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 18:54:14.013974 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 18:54:14.014868 25620 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39536
I20260811 18:54:14.016563 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25709
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:14.033283 26409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:14.017673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36168 (local address 127.19.155.193:40511)
0811 18:54:14.018406 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:14.018412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:14.018437 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:54:14.018494 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:14.018500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:14.018697 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:14.018823 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:14.019978 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.020999 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.022789 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.023727 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.023868 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:14.027921 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:14.027932 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:14.027945 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:14.027980 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:14.030607 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.031277 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.031284 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.031286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.031413 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.031739 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.031742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.031744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.032140 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:14.032467 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:14.032631 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 18:54:14.032851 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":400,"threads_started":1}
W20260811 18:54:14.034577 25914 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36168
W20260811 18:54:14.035756 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25709: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:14.036099 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25709
I20260811 18:54:14.063807 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25935
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:14.080005 26411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:14.064843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59646 (local address 127.19.155.194:40177)
0811 18:54:14.065436 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:14.065444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:14.065469 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:54:14.065533 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:14.065540 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:14.065755 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:14.065895 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:14.067172 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.068186 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.069388 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.069933 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.070037 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:14.074337 (+ 4300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:14.074347 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:14.074365 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:14.074403 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:14.077389 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.078002 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.078009 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.078012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.078141 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.078483 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.078486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.078488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.078813 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:14.079121 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:14.079406 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 18:54:14.079626 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":323,"threads_started":1}
W20260811 18:54:14.081323 26147 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59646
W20260811 18:54:14.082436 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25935: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:14.082584 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25935
I20260811 18:54:14.107723 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 26167
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[25551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474453, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:14.124758 26412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:14.108739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58052 (local address 127.19.155.195:37429)
0811 18:54:14.109433 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:14.109440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:14.109471 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:54:14.109536 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:14.109542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:14.109769 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:14.109957 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:14.111430 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.112519 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.113772 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:14.114365 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:14.114513 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:14.119064 (+ 4551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:14.119077 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:14.119092 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:14.119133 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:14.122071 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.122750 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.122757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.122759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.122947 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:14.123357 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:14.123360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:14.123363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:14.123734 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:14.123978 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:14.124246 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 18:54:14.124459 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":341,"threads_started":1}
W20260811 18:54:14.126088 26376 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58052
W20260811 18:54:14.127365 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 26167: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:54:14.127533 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 26167
I20260811 18:54:14.157653 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25571
I20260811 18:54:14.158974 25665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:14.261798 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25571
2026-08-11T18:54:14Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3927 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[26420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[26420](info): set up 2 sockets
Aug 11 18:54:14 dist-test-slave-1nl6 krb5kdc[26420](info): commencing operation
krb5kdc: starting...
W20260811 18:54:15.597170 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.008s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:15 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:15.816001 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40015
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:40015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:16.144668 26442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:16.145105 26442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:16.145275 26442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:16.152539 26442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:16.152675 26442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:16.152778 26442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:16.152882 26442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:16.152966 26442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:16.162734 26442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:40015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:16.164101 26442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:16.165416 26442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:16.177417 26456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:16.177342 26452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:16.177462 26453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:16.178633 26442 server_base.cc:1034] running on GCE node
I20260811 18:54:16.179448 26442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:16.180771 26442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:16.182011 26442 hybrid_clock.cc:648] HybridClock initialized: now 1786474456181965 us; error 51 us; skew 500 ppm
I20260811 18:54:16.182363 26442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:16 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:16.185422 26442 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:16.186991 26442 webserver.cc:460] Webserver started at http://127.19.155.254:44941/ using document root <none> and password file <none>
I20260811 18:54:16.187683 26442 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:16.187834 26442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:16.188151 26442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:16.191109 26442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "31d4f6168d5a4669a08a36d62632b490"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7d2295accb8a54d3176b609ee23d7c0f"
server_key_iv: "631d42730457fc7a5fd941a453cfac5a"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.191906 26442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "31d4f6168d5a4669a08a36d62632b490"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7d2295accb8a54d3176b609ee23d7c0f"
server_key_iv: "631d42730457fc7a5fd941a453cfac5a"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.196825 26442 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:54:16.200006 26466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:16.201220 26442 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260811 18:54:16.201407 26442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "31d4f6168d5a4669a08a36d62632b490"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7d2295accb8a54d3176b609ee23d7c0f"
server_key_iv: "631d42730457fc7a5fd941a453cfac5a"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.201606 26442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:16.223150 26442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:16.226884 26442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:16.227221 26442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:16.245370 26442 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:40015
I20260811 18:54:16.245409 26550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:40015 every 8 connection(s)
I20260811 18:54:16.246675 26442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:16.250300 26554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:16.254316 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 26442
I20260811 18:54:16.254566 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:16.255412 20079 external_mini_cluster.cc:1428] Setting key 5708bf86e1a07ef93d414ab4c8175625
I20260811 18:54:16.264669 26554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490: Bootstrap starting.
I20260811 18:54:16.268735 26554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:16.270315 26554 log.cc:824] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:54:16 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:16.273466 26554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490: No bootstrap required, opened a new log
I20260811 18:54:16.280267 26557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:16.257598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.19.155.254:40015)
0811 18:54:16.258453 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:16.258468 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:16.258523 (+ 55us) server_negotiation.cc:407] Connection header received
0811 18:54:16.260335 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:16.260361 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:16.260787 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:16.261129 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:16.263072 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.264395 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.266173 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.266874 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.267086 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:16.272375 (+ 5289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:16.272384 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:16.272399 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:16.272440 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:16.276101 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:16.276878 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:16.276894 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:16.276903 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:16.277073 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:16.277476 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:16.277483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:16.277493 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:16.278021 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:16.278363 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:16.278798 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 18:54:16.279249 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":368,"threads_started":1}
I20260811 18:54:16.282040 26554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } }
I20260811 18:54:16.282428 26554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:16.282552 26554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d4f6168d5a4669a08a36d62632b490, State: Initialized, Role: FOLLOWER
I20260811 18:54:16.283288 26554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } }
I20260811 18:54:16.283567 26554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:16.283701 26554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:16.283885 26554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:16.286367 26554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } }
I20260811 18:54:16.286870 26554 leader_election.cc:302] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31d4f6168d5a4669a08a36d62632b490; no voters:
I20260811 18:54:16.287555 26554 leader_election.cc:288] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:16.287700 26562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:16.288404 26562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [term 1 LEADER]: Becoming Leader. State: Replica: 31d4f6168d5a4669a08a36d62632b490, State: Running, Role: LEADER
I20260811 18:54:16.288971 26562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } }
I20260811 18:54:16.289678 26554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:16.293442 26565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31d4f6168d5a4669a08a36d62632b490. Latest consensus state: current_term: 1 leader_uuid: "31d4f6168d5a4669a08a36d62632b490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } } }
I20260811 18:54:16.293653 26563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31d4f6168d5a4669a08a36d62632b490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d4f6168d5a4669a08a36d62632b490" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40015 } } }
I20260811 18:54:16.293874 26565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:16.293929 26563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:16.295565 26578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:16.301247 26578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:16.309554 26578 catalog_manager.cc:1347] Generated new cluster ID: 12b9ad69739749ad83922c2d937f1069
I20260811 18:54:16.309689 26578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:16.325918 26578 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:16.327350 26578 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:16.335430 26578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31d4f6168d5a4669a08a36d62632b490: Generated new TSK 0
I20260811 18:54:16.336251 26578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:16.398329 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:16.730435 26593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:16.730695 26593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:16.730875 26593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:16.738044 26593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:16.738149 26593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:16.738339 26593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:16.747754 26593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:16.748981 26593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:16.750325 26593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:16.763478 26602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:16.763499 26606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:16.763629 26610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:16.764755 26593 server_base.cc:1034] running on GCE node
I20260811 18:54:16.765352 26593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:16.766215 26593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:16.767437 26593 hybrid_clock.cc:648] HybridClock initialized: now 1786474456767396 us; error 53 us; skew 500 ppm
I20260811 18:54:16.767755 26593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:16 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:16.770691 26593 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:16.772323 26593 webserver.cc:460] Webserver started at http://127.19.155.193:37819/ using document root <none> and password file <none>
I20260811 18:54:16.773000 26593 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:16.773144 26593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:16.773454 26593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:16.776288 26593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "66d8790b33af46969c770c00d30963af"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7c6a4a83a935e5a302171d257002f0bf"
server_key_iv: "b6ed2cb3ae99647e2158f7dd87e50623"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.777055 26593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "66d8790b33af46969c770c00d30963af"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7c6a4a83a935e5a302171d257002f0bf"
server_key_iv: "b6ed2cb3ae99647e2158f7dd87e50623"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.781937 26593 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260811 18:54:16.785300 26626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:16.786506 26593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 18:54:16.786684 26593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "66d8790b33af46969c770c00d30963af"
format_stamp: "Formatted at 2026-08-11 18:54:16 on dist-test-slave-1nl6"
server_key: "7c6a4a83a935e5a302171d257002f0bf"
server_key_iv: "b6ed2cb3ae99647e2158f7dd87e50623"
server_key_version: "encryptionkey@0"
I20260811 18:54:16.786888 26593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:16.808548 26593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:16.812713 26593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:16.813005 26593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:16.813977 26593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:16.815713 26593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:16.815815 26593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:16.815915 26593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:16.815959 26593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:16.848990 26593 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:45079
I20260811 18:54:16.849045 26803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:45079 every 8 connection(s)
I20260811 18:54:16.850298 26593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:16.859777 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 26593
I20260811 18:54:16.860004 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:16.860883 20079 external_mini_cluster.cc:1428] Setting key 564060a9831fcf89283d370f5a28da95
Aug 11 18:54:16 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:16.871018 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:16.852832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54543 (local address 127.19.155.254:40015)
0811 18:54:16.853305 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:16.853312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:16.854340 (+ 1028us) server_negotiation.cc:407] Connection header received
0811 18:54:16.856256 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:16.856260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:16.856327 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:16.856417 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:16.857833 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.858555 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.860830 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.861290 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.861397 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:16.865302 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:16.865308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:16.865311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:16.865342 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:16.867933 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:16.868664 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:16.868669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:16.868671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:16.868795 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:16.869264 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:16.869271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:16.869279 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:16.869531 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:16.869691 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:16.870407 (+ 716us) server_negotiation.cc:299] Negotiation successful
0811 18:54:16.870632 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":222,"threads_started":1}
I20260811 18:54:16.871975 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:16.853419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40015 (local address 127.19.155.193:54543)
0811 18:54:16.854169 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:16.854219 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:16.855983 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:16.856623 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:16.856630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:16.857124 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:16.857680 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:16.857698 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.858714 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.858718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:16.860673 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:16.860692 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:16.861546 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:16.861554 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:16.861756 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:16.862487 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:16.862517 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:16.865069 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:16.868079 (+ 3010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:16.868088 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:16.868104 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:16.868526 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:16.868910 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:16.868915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:16.868919 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:16.869131 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:16.869666 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:16.869674 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:16.870014 (+ 340us) client_negotiation.cc:769] Sending connection context
0811 18:54:16.870288 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 18:54:16.870809 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":288,"threads_started":1}
I20260811 18:54:16.873574 26804 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40015
I20260811 18:54:16.873905 26804 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:16.874782 26804 heartbeater.cc:511] Master 127.19.155.254:40015 requested a full tablet report, sending...
I20260811 18:54:16.877516 26490 ts_manager.cc:194] Registered new tserver with Master: 66d8790b33af46969c770c00d30963af (127.19.155.193:45079)
I20260811 18:54:16.879879 26490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:54543
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:16.914340 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:17.245347 26818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:17.245597 26818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:17.245749 26818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:17.252856 26818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:17.252966 26818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:17.253129 26818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:17.262887 26818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:17.264219 26818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:17.265496 26818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:17.278601 26827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:17.278652 26828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:17.278676 26831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:17.279490 26818 server_base.cc:1034] running on GCE node
I20260811 18:54:17.280112 26818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:17.281011 26818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:17.282246 26818 hybrid_clock.cc:648] HybridClock initialized: now 1786474457282198 us; error 53 us; skew 500 ppm
I20260811 18:54:17.282577 26818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:17.285712 26818 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:17.287151 26818 webserver.cc:460] Webserver started at http://127.19.155.194:41273/ using document root <none> and password file <none>
I20260811 18:54:17.287827 26818 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:17.287979 26818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:17.288303 26818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:17.291529 26818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "837fc7d6d390453088d941c4e9362445"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "35236fffe30f84297b66ff8502e89215"
server_key_iv: "39ad975d25657f50eef4e02b63a50225"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.292346 26818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "837fc7d6d390453088d941c4e9362445"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "35236fffe30f84297b66ff8502e89215"
server_key_iv: "39ad975d25657f50eef4e02b63a50225"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.297333 26818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 18:54:17.300616 26844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.301846 26818 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 18:54:17.302052 26818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "837fc7d6d390453088d941c4e9362445"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "35236fffe30f84297b66ff8502e89215"
server_key_iv: "39ad975d25657f50eef4e02b63a50225"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.302266 26818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:17.313866 26818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:17.317780 26818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:17.318079 26818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:17.319131 26818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:17.320483 26818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:17.320585 26818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.320734 26818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:17.320807 26818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.354223 26818 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:42109
I20260811 18:54:17.354272 27035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:42109 every 8 connection(s)
I20260811 18:54:17.355605 26818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:17.365288 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 26818
I20260811 18:54:17.365483 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:17.365922 20079 external_mini_cluster.cc:1428] Setting key 1f0945d5c925ae03514cd5af28c2b83f
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:17.376267 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.358213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:54791 (local address 127.19.155.254:40015)
0811 18:54:17.358395 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:17.358399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:17.359641 (+ 1242us) server_negotiation.cc:407] Connection header received
0811 18:54:17.361558 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:17.361565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:17.361665 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:17.361790 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:17.363370 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.364088 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.365897 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.366439 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.366586 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.370172 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:17.370186 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:17.370190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:17.370222 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:17.372888 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.373905 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.373909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.373912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.374048 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.374552 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.374555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.374557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.374803 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:17.374986 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:17.375853 (+ 867us) server_negotiation.cc:299] Negotiation successful
0811 18:54:17.376025 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:54:17.377467 27041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.358714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40015 (local address 127.19.155.194:54791)
0811 18:54:17.359476 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:17.359519 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:17.361276 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:17.362020 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:17.362028 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:17.362531 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:17.363182 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:17.363201 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.364257 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.364261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:17.365726 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:17.365743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.366676 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.366684 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:17.367001 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.367723 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:17.367760 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:17.369936 (+ 2176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:17.373054 (+ 3118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:17.373067 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:17.373085 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:17.373767 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:17.374161 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:17.374169 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:17.374175 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:17.374433 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:17.374970 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:17.374980 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:17.375437 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 18:54:17.375747 (+ 310us) client_negotiation.cc:240] Negotiation successful
0811 18:54:17.376330 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":328,"threads_started":1}
I20260811 18:54:17.378973 27036 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40015
I20260811 18:54:17.379287 27036 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:17.379968 27036 heartbeater.cc:511] Master 127.19.155.254:40015 requested a full tablet report, sending...
I20260811 18:54:17.381433 26490 ts_manager.cc:194] Registered new tserver with Master: 837fc7d6d390453088d941c4e9362445 (127.19.155.194:42109)
I20260811 18:54:17.382221 26490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:54791
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:17.417335 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:17.745151 27045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:17.745468 27045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:17.745637 27045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:17.753151 27045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:17.753293 27045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:17.753458 27045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:17.763260 27045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40015
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:17.764544 27045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:17.765813 27045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:17.779139 27054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:17.779055 27058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:17.779100 27053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:17.779937 27045 server_base.cc:1034] running on GCE node
I20260811 18:54:17.780560 27045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:17.781481 27045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:17.782714 27045 hybrid_clock.cc:648] HybridClock initialized: now 1786474457782680 us; error 55 us; skew 500 ppm
I20260811 18:54:17.783062 27045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:17.786207 27045 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:17.787747 27045 webserver.cc:460] Webserver started at http://127.19.155.195:36959/ using document root <none> and password file <none>
I20260811 18:54:17.788358 27045 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:17.788455 27045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:17.788708 27045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:17.791931 27045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "476f577f14354684b2fb6f08cb4817da"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "e4caafc02287b680962d09bdf3e82ea5"
server_key_iv: "12cc03deee278530c2d05321222e934f"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.792707 27045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "476f577f14354684b2fb6f08cb4817da"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "e4caafc02287b680962d09bdf3e82ea5"
server_key_iv: "12cc03deee278530c2d05321222e934f"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.797763 27045 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:17.801061 27067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.802287 27045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 18:54:17.802461 27045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "476f577f14354684b2fb6f08cb4817da"
format_stamp: "Formatted at 2026-08-11 18:54:17 on dist-test-slave-1nl6"
server_key: "e4caafc02287b680962d09bdf3e82ea5"
server_key_iv: "12cc03deee278530c2d05321222e934f"
server_key_version: "encryptionkey@0"
I20260811 18:54:17.802675 27045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:17.825083 27045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:17.829010 27045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:17.829352 27045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:17.830281 27045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:17.831548 27045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:17.831624 27045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.831779 27045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:17.831831 27045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:17.865079 27045 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:35775
I20260811 18:54:17.865162 27272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:35775 every 8 connection(s)
I20260811 18:54:17.866292 27045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:17.867826 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 27045
I20260811 18:54:17.867981 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:17.868374 20079 external_mini_cluster.cc:1428] Setting key cee085ea08ad9caabc072397d9c2048f
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:17.883821 26804 heartbeater.cc:503] Master 127.19.155.254:40015 was elected leader, sending a full tablet report...
I20260811 18:54:17.887144 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.870085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:37543 (local address 127.19.155.254:40015)
0811 18:54:17.870308 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:17.870315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:17.871672 (+ 1357us) server_negotiation.cc:407] Connection header received
0811 18:54:17.873507 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:17.873513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:17.873611 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:17.873696 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:17.875127 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.875844 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.877293 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.877672 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.877757 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.881024 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:17.881029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:17.881033 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:17.881063 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:17.883974 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.884780 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.884786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.884790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.884938 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.885431 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.885436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.885440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.885721 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:17.885876 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:17.886544 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 18:54:17.886781 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:54:17.887981 27277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.870668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40015 (local address 127.19.155.195:37543)
0811 18:54:17.871520 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:17.871564 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:17.873257 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:17.873889 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:17.873896 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:17.874387 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:17.874981 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:17.875002 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.875960 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.875964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:17.877163 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:17.877175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.877843 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.877847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:17.878041 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.878630 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:17.878650 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:17.880849 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:17.884104 (+ 3255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:17.884128 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:17.884170 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:17.884636 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:17.885056 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:17.885061 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:17.885065 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:17.885311 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:17.885851 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:17.885859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:17.886186 (+ 327us) client_negotiation.cc:769] Sending connection context
0811 18:54:17.886426 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 18:54:17.886902 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":376,"threads_started":1}
I20260811 18:54:17.889158 27274 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40015
I20260811 18:54:17.889454 27274 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:17.890300 27274 heartbeater.cc:511] Master 127.19.155.254:40015 requested a full tablet report, sending...
I20260811 18:54:17.891812 26490 ts_manager.cc:194] Registered new tserver with Master: 476f577f14354684b2fb6f08cb4817da (127.19.155.195:35775)
I20260811 18:54:17.892542 26490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:37543
I20260811 18:54:17.895634 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:17.950513 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.935996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60654 (local address 127.19.155.193:45079)
0811 18:54:17.936579 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:17.936587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:17.936613 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:54:17.936675 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:17.936682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:17.936909 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:17.937031 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:17.938403 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.939466 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.940574 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.941105 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.941198 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.944993 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:17.945004 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:17.945017 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:17.945048 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:17.947772 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.948397 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.948403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.948405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.948518 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.948882 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.948888 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.948891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.949241 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:17.949553 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:17.949853 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 18:54:17.950142 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":276,"threads_started":1}
Aug 11 18:54:17 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:17.967854 26806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.955061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60708 (local address 127.19.155.254:40015)
0811 18:54:17.955315 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:17.955321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:17.955442 (+ 121us) server_negotiation.cc:407] Connection header received
0811 18:54:17.955551 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:17.955556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:17.955617 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:17.955696 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:17.956807 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.957497 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.958608 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.959070 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.959163 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.962794 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:17.962799 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:17.962803 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:17.962834 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:17.965306 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.965947 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.965952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.965956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.966086 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.966465 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.966470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.966473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.966786 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:17.967059 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:17.967343 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 18:54:17.967549 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260811 18:54:17.968444 26490 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60708
I20260811 18:54:17.969347 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 26593
I20260811 18:54:17.981731 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:17.970256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60670 (local address 127.19.155.193:45079)
0811 18:54:17.970451 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:17.970456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:17.970513 (+ 57us) server_negotiation.cc:407] Connection header received
0811 18:54:17.970658 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:17.970661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:17.970744 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:17.970822 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:17.971944 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.972719 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.973856 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:17.974245 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:17.974344 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:17.977248 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:17.977258 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:17.977261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:17.977291 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:17.979660 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.980208 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.980211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.980213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.980327 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:17.980643 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:17.980646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:17.980648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:17.980862 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:17.981034 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:17.981266 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 18:54:17.981408 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:54:17.982372 26797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:18.065799 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 26593
I20260811 18:54:18.092741 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 26818
Aug 11 18:54:18 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:18.109043 27297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:18.093746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55502 (local address 127.19.155.194:42109)
0811 18:54:18.094340 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:18.094347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:18.094372 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:54:18.094434 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:18.094440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:18.094648 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:18.094850 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:18.096117 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:18.097132 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:18.098433 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:18.099059 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:18.099218 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:18.103150 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:18.103161 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:18.103176 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:18.103208 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:18.106054 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:18.106770 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:18.106777 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:18.106780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:18.106952 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:18.107354 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:18.107357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:18.107359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:18.107687 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:18.108077 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:18.108406 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 18:54:18.108672 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":298,"threads_started":1}
I20260811 18:54:18.110270 27029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:18.197188 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 26818
I20260811 18:54:18.223464 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 27045
Aug 11 18:54:18 dist-test-slave-1nl6 krb5kdc[26420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:18.239300 27303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:18.224481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.19.155.195:35775)
0811 18:54:18.225106 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:18.225113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:18.225141 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:54:18.225204 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:18.225223 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:18.225438 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:18.225567 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:18.226832 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:18.227942 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:18.229174 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:18.229722 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:18.229813 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:18.234093 (+ 4280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:18.234103 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:18.234117 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:18.234153 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:18.236909 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:18.237515 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:18.237522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:18.237524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:18.237651 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:18.237953 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:18.237956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:18.237958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:18.238275 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:18.238504 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:18.238732 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 18:54:18.238982 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":304,"threads_started":1}
I20260811 18:54:18.240615 27264 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:18.329478 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 27045
I20260811 18:54:18.352198 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 26442
I20260811 18:54:18.353413 26545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:18.455201 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 26442
2026-08-11T18:54:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4190 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:18 dist-test-slave-1nl6 krb5kdc[27310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:18 dist-test-slave-1nl6 krb5kdc[27310](info): set up 2 sockets
Aug 11 18:54:18 dist-test-slave-1nl6 krb5kdc[27310](info): commencing operation
krb5kdc: starting...
W20260811 18:54:19.751617 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:19 dist-test-slave-1nl6 krb5kdc[27310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:19.965620 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34245
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:20.301147 27332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:20.301469 27332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:20.301623 27332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:20.308388 27332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:20.308529 27332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:20.308635 27332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:20.308732 27332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:20.308828 27332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:20.318182 27332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:20.319454 27332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:20.320740 27332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:20.332280 27343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:20.332252 27341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:20.332373 27338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:20.333127 27332 server_base.cc:1034] running on GCE node
I20260811 18:54:20.333894 27332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:20.335268 27332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:20.336524 27332 hybrid_clock.cc:648] HybridClock initialized: now 1786474460336485 us; error 54 us; skew 500 ppm
I20260811 18:54:20.336889 27332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:20 dist-test-slave-1nl6 krb5kdc[27310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474460, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:20.343346 27332 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:20.344726 27332 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:20.344820 27332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:20.345090 27332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:20.347991 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "a89716e394504451bb618219e93cb115"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "ead1a80a26a2b6a37e705f8ea23b719a"
server_key_iv: "e42e772e4583e16beef4ac93417a351a"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.348747 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "a89716e394504451bb618219e93cb115"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "ead1a80a26a2b6a37e705f8ea23b719a"
server_key_iv: "e42e772e4583e16beef4ac93417a351a"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.353495 27332 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 18:54:20.356802 27351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:20.357996 27332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 18:54:20.358180 27332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "a89716e394504451bb618219e93cb115"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "ead1a80a26a2b6a37e705f8ea23b719a"
server_key_iv: "e42e772e4583e16beef4ac93417a351a"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.358407 27332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:20.398759 27332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:20.402755 27332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:20.403053 27332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:20.421216 27332 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34245
I20260811 18:54:20.421253 27448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34245 every 8 connection(s)
I20260811 18:54:20.422116 27332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:20.425547 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 27332
I20260811 18:54:20.425802 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:20.426257 27450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:20.426633 20079 external_mini_cluster.cc:1428] Setting key c0fb82200c889c89545a75a488115bb0
I20260811 18:54:20.441275 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: Bootstrap starting.
Aug 11 18:54:20 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:20.444545 27450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:20.445622 27450 log.cc:824] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:20.448372 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: No bootstrap required, opened a new log
I20260811 18:54:20.449848 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:20.428783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.19.155.254:34245)
0811 18:54:20.429635 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:20.429646 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:20.429689 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:54:20.431246 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:20.431267 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:20.431640 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:20.431958 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:20.433826 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:20.435165 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:20.437068 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:20.437766 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:20.437908 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:20.442706 (+ 4798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:20.442717 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:20.442730 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:20.442781 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:20.445937 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:20.446622 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:20.446629 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:20.446635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:20.446809 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:20.447230 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:20.447235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:20.447238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:20.447719 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:20.448034 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:20.448539 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 18:54:20.448917 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":402,"threads_started":1}
I20260811 18:54:20.456378 27450 raft_consensus.cc:348] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } }
I20260811 18:54:20.456799 27450 raft_consensus.cc:374] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:20.456926 27450 raft_consensus.cc:729] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a89716e394504451bb618219e93cb115, State: Initialized, Role: FOLLOWER
I20260811 18:54:20.457459 27450 consensus_queue.cc:260] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } }
I20260811 18:54:20.457729 27450 raft_consensus.cc:388] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:20.457877 27450 raft_consensus.cc:482] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:20.458055 27450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:20.460239 27450 raft_consensus.cc:504] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } }
I20260811 18:54:20.460713 27450 leader_election.cc:302] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a89716e394504451bb618219e93cb115; no voters:
I20260811 18:54:20.461305 27450 leader_election.cc:288] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:20.461455 27457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:20.462383 27457 raft_consensus.cc:686] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [term 1 LEADER]: Becoming Leader. State: Replica: a89716e394504451bb618219e93cb115, State: Running, Role: LEADER
I20260811 18:54:20.462967 27457 consensus_queue.cc:237] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } }
I20260811 18:54:20.463611 27450 sys_catalog.cc:564] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:20.466055 27461 sys_catalog.cc:455] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a89716e394504451bb618219e93cb115. Latest consensus state: current_term: 1 leader_uuid: "a89716e394504451bb618219e93cb115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } } }
I20260811 18:54:20.466147 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a89716e394504451bb618219e93cb115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a89716e394504451bb618219e93cb115" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34245 } } }
I20260811 18:54:20.466532 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:20.466536 27461 sys_catalog.cc:458] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:20.475919 27474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:20.481491 27474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:20.489338 27474 catalog_manager.cc:1347] Generated new cluster ID: f5d34c1cea8b4e64ab1289db55117edf
I20260811 18:54:20.489441 27474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:20.504851 27474 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:20.506625 27474 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:20.519337 27474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: Generated new TSK 0
I20260811 18:54:20.520167 27474 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:20.582453 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:20.910341 27498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:20.910609 27498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:20.910703 27498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:20.917747 27498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:20.917857 27498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:20.917969 27498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:20.927577 27498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:20.928795 27498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:20.930014 27498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:20.943001 27505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:20.942935 27508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:20.942962 27506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:20.943841 27498 server_base.cc:1034] running on GCE node
I20260811 18:54:20.944459 27498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:20.945344 27498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:20.946571 27498 hybrid_clock.cc:648] HybridClock initialized: now 1786474460946526 us; error 56 us; skew 500 ppm
I20260811 18:54:20.946880 27498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:20 dist-test-slave-1nl6 krb5kdc[27310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474460, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:20.950168 27498 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:20.951395 27498 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:20.951531 27498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:20.951854 27498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:20.954603 27498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "246f10c48d7c4988a244e4d53b40a212"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "856e271aabe2c4c4650451be79a32cd7"
server_key_iv: "1d1fe7a54375fd0f54583e5fd675e1c1"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.955458 27498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "246f10c48d7c4988a244e4d53b40a212"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "856e271aabe2c4c4650451be79a32cd7"
server_key_iv: "1d1fe7a54375fd0f54583e5fd675e1c1"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.960134 27498 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:54:20.963615 27514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:20.964947 27498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:54:20.965167 27498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "246f10c48d7c4988a244e4d53b40a212"
format_stamp: "Formatted at 2026-08-11 18:54:20 on dist-test-slave-1nl6"
server_key: "856e271aabe2c4c4650451be79a32cd7"
server_key_iv: "1d1fe7a54375fd0f54583e5fd675e1c1"
server_key_version: "encryptionkey@0"
I20260811 18:54:20.965396 27498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:20.988121 27498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:20.992581 27498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:20.992877 27498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:20.993837 27498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:20.995182 27498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:20.995306 27498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:20.995431 27498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:20.995520 27498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.027776 27498 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:37035
I20260811 18:54:21.027887 27726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:37035 every 8 connection(s)
I20260811 18:54:21.028646 27498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:21.032565 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 27498
I20260811 18:54:21.032821 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:21.033468 20079 external_mini_cluster.cc:1428] Setting key af440d3081c8eeee4f2e7b94538906fd
Aug 11 18:54:21 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474460, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:21.050954 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:21.031517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34245 (local address 127.19.155.193:38855)
0811 18:54:21.032228 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:21.032278 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:21.034070 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:21.034807 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:21.034815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:21.035459 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:21.035998 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:21.036013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.037024 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.037028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:21.038197 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:21.038209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.039033 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.039040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:21.039277 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:21.039965 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:21.039987 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:21.042319 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:21.046156 (+ 3837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:21.046162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:21.046173 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:21.046747 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:21.047313 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:21.047317 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:21.047321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:21.047583 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:21.048201 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:21.048211 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:21.048636 (+ 425us) client_negotiation.cc:769] Sending connection context
0811 18:54:21.048930 (+ 294us) client_negotiation.cc:240] Negotiation successful
0811 18:54:21.049472 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":254,"threads_started":1}
I20260811 18:54:21.051955 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:21.031099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:38855 (local address 127.19.155.254:34245)
0811 18:54:21.031526 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:21.031530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:21.032394 (+ 864us) server_negotiation.cc:407] Connection header received
0811 18:54:21.034374 (+ 1980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:21.034378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:21.034497 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:21.034637 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:21.036168 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.036870 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.038387 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.038768 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.038911 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:21.042525 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:21.042530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:21.042533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:21.042565 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:21.045996 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:21.046945 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:21.046951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:21.046954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:21.047140 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:21.047702 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:21.047717 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:21.047723 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:21.048075 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:21.048224 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:21.051552 (+ 3328us) server_negotiation.cc:299] Negotiation successful
0811 18:54:21.051720 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":239,"threads_started":1}
I20260811 18:54:21.053259 27727 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34245
I20260811 18:54:21.053563 27727 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:21.054191 27727 heartbeater.cc:511] Master 127.19.155.254:34245 requested a full tablet report, sending...
I20260811 18:54:21.056660 27390 ts_manager.cc:194] Registered new tserver with Master: 246f10c48d7c4988a244e4d53b40a212 (127.19.155.193:37035)
I20260811 18:54:21.058807 27390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:38855
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:21.088135 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:21.409933 27737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:21.410193 27737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:21.410285 27737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:21.417290 27737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:21.417388 27737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:21.417542 27737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:21.426723 27737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:21.427872 27737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:21.429105 27737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:21.441645 27747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:21.441706 27745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:21.442189 27749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:21.442368 27737 server_base.cc:1034] running on GCE node
I20260811 18:54:21.443089 27737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:21.443956 27737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:21.445178 27737 hybrid_clock.cc:648] HybridClock initialized: now 1786474461445144 us; error 44 us; skew 500 ppm
I20260811 18:54:21.445510 27737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:21 dist-test-slave-1nl6 krb5kdc[27310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:21.448596 27737 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:21.449669 27737 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:21.449810 27737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:21.450121 27737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:21.453047 27737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "0c0b5bdc895e4ece9801adc7055590ba"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "21113f1d76df1fe86e6671171e5e66d2"
server_key_iv: "ae7fea0e3d3aab9e9fd2b6de7ae10709"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.453843 27737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "0c0b5bdc895e4ece9801adc7055590ba"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "21113f1d76df1fe86e6671171e5e66d2"
server_key_iv: "ae7fea0e3d3aab9e9fd2b6de7ae10709"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.458666 27737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260811 18:54:21.462121 27764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.463444 27737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:54:21.463667 27737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "0c0b5bdc895e4ece9801adc7055590ba"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "21113f1d76df1fe86e6671171e5e66d2"
server_key_iv: "ae7fea0e3d3aab9e9fd2b6de7ae10709"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.463897 27737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:21.491077 27737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:21.494825 27737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:21.495128 27737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:21.496065 27737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:21.497394 27737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:21.497514 27737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.497649 27737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:21.497738 27737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.531062 27737 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:46305
I20260811 18:54:21.531107 27969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:46305 every 8 connection(s)
I20260811 18:54:21.531924 27737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:21.539685 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 27737
I20260811 18:54:21.539873 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:21.540421 20079 external_mini_cluster.cc:1428] Setting key 0b3b15375cf535c2444c5b3d34744cf8
Aug 11 18:54:21 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:21.553013 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:21.534397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:44103 (local address 127.19.155.254:34245)
0811 18:54:21.534577 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:21.534581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:21.535793 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 18:54:21.537526 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:21.537533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:21.537626 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:21.537747 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:21.539153 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.540206 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.541917 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.542470 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.542599 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:21.546166 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:21.546175 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:21.546183 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:21.546232 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:21.549839 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:21.550624 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:21.550633 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:21.550639 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:21.550806 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:21.551272 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:21.551280 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:21.551286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:21.551605 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:21.551772 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:21.552452 (+ 680us) server_negotiation.cc:299] Negotiation successful
0811 18:54:21.552669 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:21.553942 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:21.534855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34245 (local address 127.19.155.194:44103)
0811 18:54:21.535633 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:21.535677 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:21.537249 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:21.537919 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:21.537926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:21.538411 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:21.538998 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:21.539018 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.540353 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.540357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:21.541767 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:21.541781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:21.542685 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:21.542690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:21.542876 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:21.543612 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:21.543634 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:21.545935 (+ 2301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:21.550048 (+ 4113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:21.550055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:21.550066 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:21.550487 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:21.550975 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:21.550978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:21.550981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:21.551145 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:21.551742 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:21.551750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:21.552065 (+ 315us) client_negotiation.cc:769] Sending connection context
0811 18:54:21.552367 (+ 302us) client_negotiation.cc:240] Negotiation successful
0811 18:54:21.552867 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":312,"threads_started":1}
I20260811 18:54:21.555382 27971 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34245
I20260811 18:54:21.555677 27971 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:21.556313 27971 heartbeater.cc:511] Master 127.19.155.254:34245 requested a full tablet report, sending...
I20260811 18:54:21.557804 27390 ts_manager.cc:194] Registered new tserver with Master: 0c0b5bdc895e4ece9801adc7055590ba (127.19.155.194:46305)
I20260811 18:54:21.559113 27390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:44103
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:21.593497 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:21.918763 27986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:21.919037 27986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:21.919196 27986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:21.926056 27986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:21.926151 27986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:21.926355 27986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:21.935642 27986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34245
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:21.936889 27986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:21.938190 27986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:21.951126 27994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:21.951195 27993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:21.951195 27996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:21.952358 27986 server_base.cc:1034] running on GCE node
I20260811 18:54:21.952939 27986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:21.953835 27986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:21.955063 27986 hybrid_clock.cc:648] HybridClock initialized: now 1786474461955017 us; error 57 us; skew 500 ppm
I20260811 18:54:21.955389 27986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:21 dist-test-slave-1nl6 krb5kdc[27310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:21.958545 27986 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:21.959753 27986 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:21.959893 27986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:21.960228 27986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:21.963485 27986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "81d2602417b3403fb1af3425563e86a1"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "9b832480a59916fea1df31f74f803e38"
server_key_iv: "3f58c04bdcdc2a60714037f96b57e193"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.964442 27986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "81d2602417b3403fb1af3425563e86a1"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "9b832480a59916fea1df31f74f803e38"
server_key_iv: "3f58c04bdcdc2a60714037f96b57e193"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.969579 27986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 18:54:21.973033 28012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.974321 27986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:21.974506 27986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "81d2602417b3403fb1af3425563e86a1"
format_stamp: "Formatted at 2026-08-11 18:54:21 on dist-test-slave-1nl6"
server_key: "9b832480a59916fea1df31f74f803e38"
server_key_iv: "3f58c04bdcdc2a60714037f96b57e193"
server_key_version: "encryptionkey@0"
I20260811 18:54:21.974727 27986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:21.989136 27986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:21.993028 27986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:21.993319 27986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:21.994266 27986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:21.995680 27986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:21.995819 27986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:21.995942 27986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:21.996037 27986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:22.030058 27986 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:43015
I20260811 18:54:22.030078 28196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:43015 every 8 connection(s)
I20260811 18:54:22.031193 27986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:22.034117 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 27986
I20260811 18:54:22.034336 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:22.034955 20079 external_mini_cluster.cc:1428] Setting key b1a90eaa8fb33cd48bf51bdd65aa1412
Aug 11 18:54:22 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:22.051895 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.033871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:57423 (local address 127.19.155.254:34245)
0811 18:54:22.034069 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.034076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.035489 (+ 1413us) server_negotiation.cc:407] Connection header received
0811 18:54:22.037825 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.037833 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.037923 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.038033 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:22.039541 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.040295 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.041787 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.042197 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.042338 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.045676 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:22.045682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:22.045687 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:22.045731 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:22.048245 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.048978 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.048985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.048989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.049179 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.049754 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.049759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.049762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.050139 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:22.050317 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.051303 (+ 986us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.051524 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:54:22.053046 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.034450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34245 (local address 127.19.155.195:57423)
0811 18:54:22.035327 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.035363 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.037516 (+ 2153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.038286 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.038293 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.038782 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:22.039374 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.039391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.040449 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.040462 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.041633 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.041645 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.042431 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.042440 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.042656 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.043371 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:22.043398 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:22.045484 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:22.048389 (+ 2905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:22.048398 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:22.048411 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:22.048843 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:22.049316 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:22.049320 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:22.049322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:22.049574 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:22.050313 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:22.050322 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:22.050732 (+ 410us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.051085 (+ 353us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.051714 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":395,"threads_started":1}
I20260811 18:54:22.054322 28199 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34245
I20260811 18:54:22.054615 28199 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:22.055321 28199 heartbeater.cc:511] Master 127.19.155.254:34245 requested a full tablet report, sending...
I20260811 18:54:22.056682 27390 ts_manager.cc:194] Registered new tserver with Master: 81d2602417b3403fb1af3425563e86a1 (127.19.155.195:43015)
I20260811 18:54:22.057490 27390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:57423
I20260811 18:54:22.061866 27727 heartbeater.cc:503] Master 127.19.155.254:34245 was elected leader, sending a full tablet report...
I20260811 18:54:22.062594 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:54:22.079788 27732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.067282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47692 (local address 127.19.155.254:34245)
0811 18:54:22.067435 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.067439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.068034 (+ 595us) server_negotiation.cc:407] Connection header received
0811 18:54:22.068232 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.068237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.068339 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.068472 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:22.069894 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.070622 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.071914 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.072441 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.072534 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.074795 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:22.074800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:22.074803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:22.074831 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:22.077349 (+ 2518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.077932 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.077936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.077938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.078127 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.078510 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.078514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.078516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.078939 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:22.079172 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.079433 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.079579 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:54:22.083592 27390 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:22.090356 27390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:22.126613 28225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.102183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:46305 (local address 127.0.0.1:50674)
0811 18:54:22.117608 (+ 15425us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.117674 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.117889 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.119746 (+ 1857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.119754 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.119784 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:22.120228 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.120249 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.121899 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.121904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.124181 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.124200 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.125519 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.125528 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.125790 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.125851 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.125978 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.126154 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15115,"mutex_wait_us":114,"thread_start_us":15905,"threads_started":1}
I20260811 18:54:22.127538 28226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.102313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.19.155.194:46305)
0811 18:54:22.117588 (+ 15275us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.117601 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.117857 (+ 256us) server_negotiation.cc:407] Connection header received
0811 18:54:22.118818 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.118831 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.119138 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.119337 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:22.120473 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.121760 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.124368 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.125292 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.125490 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.125668 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.127028 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.127223 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15060,"thread_start_us":15308,"threads_started":1}
I20260811 18:54:22.127709 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.103307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56136 (local address 127.19.155.193:37035)
0811 18:54:22.119053 (+ 15746us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.119065 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.119097 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:54:22.119209 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.119218 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.119446 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.119644 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:22.120710 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.122290 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.124511 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.125965 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.126166 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.126349 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.127202 (+ 853us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.127376 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15543,"thread_start_us":15349,"threads_started":1}
I20260811 18:54:22.127599 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.103623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:37035 (local address 127.0.0.1:56136)
0811 18:54:22.118319 (+ 14696us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.118337 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.118448 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.119928 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.119933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.119959 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:22.120508 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.120522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.122448 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.122453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.124347 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.124362 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.126503 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.126510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.126991 (+ 481us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.127029 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.127130 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.127245 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14576,"mutex_wait_us":50,"thread_start_us":14427,"threads_started":1}
I20260811 18:54:22.128567 28236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.103682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:43015 (local address 127.0.0.1:40094)
0811 18:54:22.119363 (+ 15681us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.119381 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.119489 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.121143 (+ 1654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.121148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.121171 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:22.121520 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.121530 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.123409 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.123414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.125577 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.125592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.127773 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.127780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.127944 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.127980 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.128069 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.128216 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15543,"mutex_wait_us":1,"thread_start_us":15353,"threads_started":1}
I20260811 18:54:22.129112 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.103308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.19.155.195:43015)
0811 18:54:22.120283 (+ 16975us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.120293 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.120328 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:54:22.120437 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.120447 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.120654 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.120849 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:22.121775 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.123255 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.125820 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.127290 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.127467 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.127622 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.128457 (+ 835us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.128617 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16779,"thread_start_us":16421,"threads_started":1}
I20260811 18:54:22.131414 27846 tablet_service.cc:1467] Processing CreateTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 (DEFAULT_TABLE table=test-table [id=2452ba63269b4ffc804db2704a5ba606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:22.131814 27610 tablet_service.cc:1467] Processing CreateTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 (DEFAULT_TABLE table=test-table [id=2452ba63269b4ffc804db2704a5ba606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:22.132680 27846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 875ed0e7b59140f3b251373ca0ce9475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:22.132655 28094 tablet_service.cc:1467] Processing CreateTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 (DEFAULT_TABLE table=test-table [id=2452ba63269b4ffc804db2704a5ba606]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:22.133824 27610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 875ed0e7b59140f3b251373ca0ce9475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:22.133991 28094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 875ed0e7b59140f3b251373ca0ce9475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:22.149085 28238 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Bootstrap starting.
I20260811 18:54:22.150063 28240 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Bootstrap starting.
I20260811 18:54:22.151612 28241 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Bootstrap starting.
I20260811 18:54:22.153203 28238 tablet_bootstrap.cc:654] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:22.154443 28240 tablet_bootstrap.cc:654] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:22.154448 28241 tablet_bootstrap.cc:654] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:22.154501 28238 log.cc:824] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:22.155681 28241 log.cc:824] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:22.155833 28240 log.cc:824] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:22.158982 28241 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: No bootstrap required, opened a new log
I20260811 18:54:22.159296 28241 ts_tablet_manager.cc:1397] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 18:54:22.159632 28238 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: No bootstrap required, opened a new log
I20260811 18:54:22.159891 28238 ts_tablet_manager.cc:1397] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260811 18:54:22.160001 28240 tablet_bootstrap.cc:492] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: No bootstrap required, opened a new log
I20260811 18:54:22.160372 28240 ts_tablet_manager.cc:1397] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 18:54:22.171783 28240 raft_consensus.cc:348] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.172267 28240 raft_consensus.cc:374] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:22.172384 28240 raft_consensus.cc:729] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 246f10c48d7c4988a244e4d53b40a212, State: Initialized, Role: FOLLOWER
I20260811 18:54:22.172511 28238 raft_consensus.cc:348] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.173067 28238 raft_consensus.cc:374] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:22.173030 28240 consensus_queue.cc:260] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.173198 28238 raft_consensus.cc:729] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d2602417b3403fb1af3425563e86a1, State: Initialized, Role: FOLLOWER
I20260811 18:54:22.172957 28241 raft_consensus.cc:348] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.173810 28241 raft_consensus.cc:374] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:22.173950 28241 raft_consensus.cc:729] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0b5bdc895e4ece9801adc7055590ba, State: Initialized, Role: FOLLOWER
I20260811 18:54:22.173871 28238 consensus_queue.cc:260] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.174608 28241 consensus_queue.cc:260] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.175149 28199 heartbeater.cc:503] Master 127.19.155.254:34245 was elected leader, sending a full tablet report...
I20260811 18:54:22.176491 27971 heartbeater.cc:503] Master 127.19.155.254:34245 was elected leader, sending a full tablet report...
I20260811 18:54:22.176484 28241 ts_tablet_manager.cc:1428] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Time spent starting tablet: real 0.017s user 0.010s sys 0.003s
I20260811 18:54:22.178231 28238 ts_tablet_manager.cc:1428] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260811 18:54:22.180135 28240 ts_tablet_manager.cc:1428] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Time spent starting tablet: real 0.020s user 0.009s sys 0.004s
I20260811 18:54:22.280999 28247 raft_consensus.cc:482] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 18:54:22.281049 27728 tablet.cc:2369] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:22.281387 28247 raft_consensus.cc:504] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
W20260811 18:54:22.282850 28200 tablet.cc:2369] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:22.283269 28247 leader_election.cc:288] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0b5bdc895e4ece9801adc7055590ba (127.19.155.194:46305), 81d2602417b3403fb1af3425563e86a1 (127.19.155.195:43015)
W20260811 18:54:22.284081 27975 tablet.cc:2369] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:22.289979 28226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.283862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:46887 (local address 127.19.155.194:46305)
0811 18:54:22.284128 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.284138 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.284665 (+ 527us) server_negotiation.cc:407] Connection header received
0811 18:54:22.284779 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.284788 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.284892 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.285020 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:22.285744 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.286480 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.288316 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.289065 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.289257 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.289335 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.289611 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.289729 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:54:22.290046 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.283566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:46305 (local address 127.19.155.193:46887)
0811 18:54:22.284323 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.284350 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.284514 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.285067 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.285074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.285121 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:22.285588 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.285600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.286610 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.286617 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.288146 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.288158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.289289 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.289295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.289446 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.289468 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.289571 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.289697 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":1051,"threads_started":1}
I20260811 18:54:22.290380 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.284353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:32777 (local address 127.19.155.195:43015)
0811 18:54:22.284609 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.284617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.285454 (+ 837us) server_negotiation.cc:407] Connection header received
0811 18:54:22.285629 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.285632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.285689 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.285795 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:22.286319 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.287039 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.288719 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.289492 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.289670 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.289744 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.290011 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.290131 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:54:22.290453 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.283777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:43015 (local address 127.19.155.193:32777)
0811 18:54:22.285340 (+ 1563us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:22.285363 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:22.285492 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:22.285828 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:22.285833 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:22.285861 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:22.286149 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.286157 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.287207 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.287211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.288561 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:22.288572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.289708 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.289714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:22.289862 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.289885 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:54:22.289986 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:54:22.290109 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1430,"thread_start_us":1221,"threads_started":1}
I20260811 18:54:22.291160 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "875ed0e7b59140f3b251373ca0ce9475" candidate_uuid: "246f10c48d7c4988a244e4d53b40a212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0b5bdc895e4ece9801adc7055590ba" is_pre_election: true
I20260811 18:54:22.291473 28128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "875ed0e7b59140f3b251373ca0ce9475" candidate_uuid: "246f10c48d7c4988a244e4d53b40a212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d2602417b3403fb1af3425563e86a1" is_pre_election: true
I20260811 18:54:22.291813 27885 raft_consensus.cc:2454] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246f10c48d7c4988a244e4d53b40a212 in term 0.
I20260811 18:54:22.292021 28128 raft_consensus.cc:2454] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 246f10c48d7c4988a244e4d53b40a212 in term 0.
I20260811 18:54:22.292593 27517 leader_election.cc:302] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0b5bdc895e4ece9801adc7055590ba, 246f10c48d7c4988a244e4d53b40a212; no voters:
I20260811 18:54:22.293037 28247 raft_consensus.cc:2781] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:22.293179 28247 raft_consensus.cc:482] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:22.293308 28247 raft_consensus.cc:3037] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:22.295609 28247 raft_consensus.cc:504] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.296332 28247 leader_election.cc:288] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0b5bdc895e4ece9801adc7055590ba (127.19.155.194:46305), 81d2602417b3403fb1af3425563e86a1 (127.19.155.195:43015)
I20260811 18:54:22.296870 27885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "875ed0e7b59140f3b251373ca0ce9475" candidate_uuid: "246f10c48d7c4988a244e4d53b40a212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0b5bdc895e4ece9801adc7055590ba"
I20260811 18:54:22.296891 28128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "875ed0e7b59140f3b251373ca0ce9475" candidate_uuid: "246f10c48d7c4988a244e4d53b40a212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d2602417b3403fb1af3425563e86a1"
I20260811 18:54:22.297075 27885 raft_consensus.cc:3037] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:22.297115 28128 raft_consensus.cc:3037] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:22.299371 27885 raft_consensus.cc:2454] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246f10c48d7c4988a244e4d53b40a212 in term 1.
I20260811 18:54:22.299420 28128 raft_consensus.cc:2454] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 246f10c48d7c4988a244e4d53b40a212 in term 1.
I20260811 18:54:22.299753 27517 leader_election.cc:302] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0b5bdc895e4ece9801adc7055590ba, 246f10c48d7c4988a244e4d53b40a212; no voters:
I20260811 18:54:22.300027 28247 raft_consensus.cc:2781] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:22.300482 28247 raft_consensus.cc:686] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 1 LEADER]: Becoming Leader. State: Replica: 246f10c48d7c4988a244e4d53b40a212, State: Running, Role: LEADER
I20260811 18:54:22.300969 28247 consensus_queue.cc:237] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } }
I20260811 18:54:22.305312 27390 catalog_manager.cc:5495] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 reported cstate change: term changed from 0 to 1, leader changed from <none> to 246f10c48d7c4988a244e4d53b40a212 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "246f10c48d7c4988a244e4d53b40a212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "246f10c48d7c4988a244e4d53b40a212" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 37035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:22.354326 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.349554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56142 (local address 127.19.155.193:37035)
0811 18:54:22.349733 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.349738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.349755 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:54:22.349938 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.349941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.350027 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.350160 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:22.350508 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.351244 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.352521 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.352902 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.352988 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.353401 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:22.353869 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:22.353984 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.354079 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.354138 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:54:22.362144 28128 raft_consensus.cc:1261] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 1 FOLLOWER]: Refusing update from remote peer 246f10c48d7c4988a244e4d53b40a212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:22.362242 27885 raft_consensus.cc:1261] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 1 FOLLOWER]: Refusing update from remote peer 246f10c48d7c4988a244e4d53b40a212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:22.363261 28252 consensus_queue.cc:1035] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d2602417b3403fb1af3425563e86a1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:22.363606 28247 consensus_queue.cc:1035] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0b5bdc895e4ece9801adc7055590ba" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:22.380280 28255 mvcc.cc:205] Tried to move back new op lower bound from 7317399397825531904 to 7317399397588242432. Current Snapshot: MvccSnapshot[applied={T|T < 7317399397825531904}]
I20260811 18:54:22.384927 28256 mvcc.cc:205] Tried to move back new op lower bound from 7317399397825531904 to 7317399397588242432. Current Snapshot: MvccSnapshot[applied={T|T < 7317399397825531904}]
I20260811 18:54:22.393703 27388 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:22.394042 27388 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:22.397919 27388 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a89716e394504451bb618219e93cb115: Sending DeleteTablet for 3 replicas of tablet 875ed0e7b59140f3b251373ca0ce9475
I20260811 18:54:22.399012 27846 tablet_service.cc:1514] Processing DeleteTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:50674
I20260811 18:54:22.399019 27610 tablet_service.cc:1514] Processing DeleteTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:56136
I20260811 18:54:22.399148 28094 tablet_service.cc:1514] Processing DeleteTablet for tablet 875ed0e7b59140f3b251373ca0ce9475 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:40094
I20260811 18:54:22.402688 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 27498
I20260811 18:54:22.409878 28271 tablet_replica.cc:330] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: stopping tablet replica
I20260811 18:54:22.410320 28271 raft_consensus.cc:2229] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:22.410851 28271 raft_consensus.cc:2258] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:22.413158 28271 ts_tablet_manager.cc:1905] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:22.419412 28270 tablet_replica.cc:330] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: stopping tablet replica
I20260811 18:54:22.419821 28270 raft_consensus.cc:2229] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:22.420521 28270 raft_consensus.cc:2258] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:22.422681 28270 ts_tablet_manager.cc:1905] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:22.429723 28271 ts_tablet_manager.cc:1918] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:22.429919 28271 log.cc:1196] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/875ed0e7b59140f3b251373ca0ce9475
I20260811 18:54:22.430509 28271 ts_tablet_manager.cc:1939] T 875ed0e7b59140f3b251373ca0ce9475 P 81d2602417b3403fb1af3425563e86a1: Deleting consensus metadata
I20260811 18:54:22.431442 28269 tablet_replica.cc:330] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: stopping tablet replica
I20260811 18:54:22.431908 28269 raft_consensus.cc:2229] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:22.432443 28269 raft_consensus.cc:2258] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:22.433230 28270 ts_tablet_manager.cc:1918] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:22.433385 28270 log.cc:1196] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/875ed0e7b59140f3b251373ca0ce9475
I20260811 18:54:22.433944 28270 ts_tablet_manager.cc:1939] T 875ed0e7b59140f3b251373ca0ce9475 P 246f10c48d7c4988a244e4d53b40a212: Deleting consensus metadata
I20260811 18:54:22.434612 28269 ts_tablet_manager.cc:1905] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:22.436347 27359 catalog_manager.cc:4841] TS 246f10c48d7c4988a244e4d53b40a212 (127.19.155.193:37035): tablet 875ed0e7b59140f3b251373ca0ce9475 (table test-table [id=2452ba63269b4ffc804db2704a5ba606]) successfully deleted
I20260811 18:54:22.438975 27357 catalog_manager.cc:4841] TS 81d2602417b3403fb1af3425563e86a1 (127.19.155.195:43015): tablet 875ed0e7b59140f3b251373ca0ce9475 (table test-table [id=2452ba63269b4ffc804db2704a5ba606]) successfully deleted
Aug 11 18:54:22 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:22.444053 28269 ts_tablet_manager.cc:1918] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:22.444223 28269 log.cc:1196] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/875ed0e7b59140f3b251373ca0ce9475
I20260811 18:54:22.444793 28269 ts_tablet_manager.cc:1939] T 875ed0e7b59140f3b251373ca0ce9475 P 0c0b5bdc895e4ece9801adc7055590ba: Deleting consensus metadata
I20260811 18:54:22.446630 27358 catalog_manager.cc:4841] TS 0c0b5bdc895e4ece9801adc7055590ba (127.19.155.194:46305): tablet 875ed0e7b59140f3b251373ca0ce9475 (table test-table [id=2452ba63269b4ffc804db2704a5ba606]) successfully deleted
I20260811 18:54:22.449563 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.404585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56148 (local address 127.19.155.193:37035)
0811 18:54:22.404794 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.404802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.407920 (+ 3118us) server_negotiation.cc:407] Connection header received
0811 18:54:22.408100 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.408108 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.408237 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.408357 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:22.419450 (+ 11093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.421146 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.435198 (+ 14052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.435916 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.436007 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.442024 (+ 6017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:22.442048 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:22.442070 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:22.442125 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:22.446113 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.447123 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.447134 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.447137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.447351 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.447804 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.447810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.447813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.448257 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:22.448604 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.448913 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.449171 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:22.450670 27715 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:22.549927 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 27498
I20260811 18:54:22.583108 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 27737
Aug 11 18:54:22 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:22.597239 28226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.583934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50680 (local address 127.19.155.194:46305)
0811 18:54:22.584132 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.584137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.584156 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:22.584290 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.584294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.584358 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.584448 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:22.585605 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.586329 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.587547 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.587932 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.588024 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.592009 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:22.592020 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:22.592036 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:22.592065 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:22.594781 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.595433 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.595440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.595443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.595567 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.595910 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.595913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.595915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.596276 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:22.596486 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.596731 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.596890 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:22.597958 27963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:22.689656 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 27737
I20260811 18:54:22.716531 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 27986
Aug 11 18:54:22 dist-test-slave-1nl6 krb5kdc[27310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:22.731566 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:22.717289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.19.155.195:43015)
0811 18:54:22.717480 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:22.717488 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:22.717511 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:54:22.717737 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:22.717741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:22.717805 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:22.717910 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:22.719348 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.720045 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.721201 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:22.721584 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:22.721711 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:22.726000 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:22.726013 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:22.726030 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:22.726062 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:22.728874 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.729506 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.729513 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.729516 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.729646 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:22.730036 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:22.730042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:22.730045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:22.730403 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:22.730706 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:22.731022 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 18:54:22.731269 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:22.732211 28192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:22.820189 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 27986
I20260811 18:54:22.846539 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 27332
I20260811 18:54:22.847808 27442 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:22.955868 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 27332
2026-08-11T18:54:22Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4499 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T18:54:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:23Z Disabled control of system clock
I20260811 18:54:23.037159 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40943
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:40943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:54:23.364056 28289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:23.364357 28289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:23.364501 28289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:23.371223 28289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:23.371322 28289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:23.371368 28289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:23.371424 28289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:23.371469 28289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:23.380211 28289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:40943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:23.381352 28289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:23.383077 28289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:23.394536 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:23.394569 28300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:23.394641 28299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:23.395181 28289 server_base.cc:1034] running on GCE node
I20260811 18:54:23.395974 28289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:23.397151 28289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:23.398352 28289 hybrid_clock.cc:648] HybridClock initialized: now 1786474463398292 us; error 46 us; skew 500 ppm
I20260811 18:54:23.398639 28289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:23.400864 28289 webserver.cc:460] Webserver started at http://127.19.155.254:36145/ using document root <none> and password file <none>
I20260811 18:54:23.401451 28289 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:23.401533 28289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:23.401796 28289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:23.404523 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "dc31fb9152da417a836d2e1caea43c73"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "23a0d7fbd20680d701984a178729afc3"
server_key_iv: "f32a933bde597bbc3e693c37b7ccbcdb"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.405282 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "dc31fb9152da417a836d2e1caea43c73"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "23a0d7fbd20680d701984a178729afc3"
server_key_iv: "f32a933bde597bbc3e693c37b7ccbcdb"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.410056 28289 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260811 18:54:23.413203 28312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:23.414398 28289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 18:54:23.414556 28289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "dc31fb9152da417a836d2e1caea43c73"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "23a0d7fbd20680d701984a178729afc3"
server_key_iv: "f32a933bde597bbc3e693c37b7ccbcdb"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.414754 28289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:23.420085 28289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:23.420815 28289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:23.421103 28289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:23.438704 28289 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:40943
I20260811 18:54:23.438735 28404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:40943 every 8 connection(s)
I20260811 18:54:23.440043 28289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:23.443639 28405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:23.446110 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 28289
I20260811 18:54:23.446309 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:23.447155 20079 external_mini_cluster.cc:1428] Setting key 098afdd1f82caafd2bb2603dad0385e9
I20260811 18:54:23.456020 28410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:23.449271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41194 (local address 127.19.155.254:40943)
0811 18:54:23.450277 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:23.450288 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:23.450327 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:54:23.451961 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:23.451983 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:23.452400 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:23.452794 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:23.454232 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:23.454241 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:23.454258 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:23.454278 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:23.454351 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:23.454381 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:23.454589 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:23.454867 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 18:54:23.455167 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":364,"threads_started":1}
I20260811 18:54:23.456408 28405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: Bootstrap starting.
I20260811 18:54:23.459513 28405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:23.460505 28405 log.cc:824] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:23.463200 28405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: No bootstrap required, opened a new log
I20260811 18:54:23.470381 28405 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } }
I20260811 18:54:23.470723 28405 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:23.470844 28405 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc31fb9152da417a836d2e1caea43c73, State: Initialized, Role: FOLLOWER
I20260811 18:54:23.471491 28405 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } }
I20260811 18:54:23.471729 28405 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:23.471866 28405 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:23.472035 28405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:23.474277 28405 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } }
I20260811 18:54:23.474762 28405 leader_election.cc:302] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc31fb9152da417a836d2e1caea43c73; no voters:
I20260811 18:54:23.475346 28405 leader_election.cc:288] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:23.475453 28414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:23.476187 28414 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [term 1 LEADER]: Becoming Leader. State: Replica: dc31fb9152da417a836d2e1caea43c73, State: Running, Role: LEADER
I20260811 18:54:23.476785 28414 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } }
I20260811 18:54:23.477453 28405 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:23.479729 28418 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc31fb9152da417a836d2e1caea43c73. Latest consensus state: current_term: 1 leader_uuid: "dc31fb9152da417a836d2e1caea43c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } } }
I20260811 18:54:23.479959 28416 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc31fb9152da417a836d2e1caea43c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc31fb9152da417a836d2e1caea43c73" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40943 } } }
I20260811 18:54:23.480233 28418 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:23.480329 28416 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:23.483223 28429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:23.488320 28429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:23.497507 28429 catalog_manager.cc:1347] Generated new cluster ID: aaa2610be2b241e8ad3c8c9a6920e006
I20260811 18:54:23.497649 28429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:23.511489 28429 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:23.511921 28429 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:23.520203 28429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: Generated new TSK 0
I20260811 18:54:23.521109 28429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:54:23.526587 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--builtin_ntp_servers=127.19.155.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:54:23.862373 28445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:23.862640 28445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:23.862802 28445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:23.869989 28445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:23.870082 28445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:23.870239 28445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:23.879382 28445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:23.880649 28445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:23.882604 28445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:23.895887 28451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:23.895854 28453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:23.895916 28455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:23.896737 28445 server_base.cc:1034] running on GCE node
I20260811 18:54:23.897291 28445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:23.898239 28445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:23.899451 28445 hybrid_clock.cc:648] HybridClock initialized: now 1786474463899410 us; error 31 us; skew 500 ppm
I20260811 18:54:23.899778 28445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:23.902021 28445 webserver.cc:460] Webserver started at http://127.19.155.193:46603/ using document root <none> and password file <none>
I20260811 18:54:23.902681 28445 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:23.902805 28445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:23.903160 28445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:23.905930 28445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "350848aaedff49c5955e592e36a57f2a"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "12701607a25a743912b44c26c159a35f"
server_key_iv: "601c51a689f0dd75d19a18eb46bfd186"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.906745 28445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "350848aaedff49c5955e592e36a57f2a"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "12701607a25a743912b44c26c159a35f"
server_key_iv: "601c51a689f0dd75d19a18eb46bfd186"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.911710 28445 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 18:54:23.915047 28462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:23.916568 28445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:23.916749 28445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "350848aaedff49c5955e592e36a57f2a"
format_stamp: "Formatted at 2026-08-11 18:54:23 on dist-test-slave-1nl6"
server_key: "12701607a25a743912b44c26c159a35f"
server_key_iv: "601c51a689f0dd75d19a18eb46bfd186"
server_key_version: "encryptionkey@0"
I20260811 18:54:23.916981 28445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:23.922668 28445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:23.923502 28445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:23.923770 28445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:23.924700 28445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:23.926100 28445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:23.926214 28445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:23.926353 28445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:23.926450 28445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:23.959699 28445 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:44271
I20260811 18:54:23.959764 28651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:44271 every 8 connection(s)
I20260811 18:54:23.961009 28445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:23.969111 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:23.963598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57321 (local address 127.19.155.254:40943)
0811 18:54:23.964005 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:23.964010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:23.965247 (+ 1237us) server_negotiation.cc:407] Connection header received
0811 18:54:23.966917 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:23.966924 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:23.966997 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:23.967114 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:23.968349 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:23.968355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:23.968360 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:23.968379 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:23.968425 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:23.968436 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:23.968554 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:23.968759 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 18:54:23.968827 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":212,"threads_started":1}
I20260811 18:54:23.969543 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 28445
I20260811 18:54:23.969736 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:23.970098 28658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:23.964212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40943 (local address 127.19.155.193:57321)
0811 18:54:23.965094 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:23.965136 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:23.966610 (+ 1474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:23.967346 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:23.967354 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:23.967438 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:23.968060 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:23.968062 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:23.968098 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:23.968179 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:23.968542 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:23.968553 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:23.968561 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:54:23.968852 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 18:54:23.969118 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":264,"threads_started":1}
I20260811 18:54:23.970526 20079 external_mini_cluster.cc:1428] Setting key 385a3c2d88705e13389e660ceb738975
I20260811 18:54:23.971715 28652 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40943
I20260811 18:54:23.972000 28652 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:23.972635 28652 heartbeater.cc:511] Master 127.19.155.254:40943 requested a full tablet report, sending...
I20260811 18:54:23.973592 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--builtin_ntp_servers=127.19.155.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 18:54:23.974603 28348 ts_manager.cc:194] Registered new tserver with Master: 350848aaedff49c5955e592e36a57f2a (127.19.155.193:44271)
W20260811 18:54:24.305371 28659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:24.305630 28659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:24.305806 28659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:24.312856 28659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:24.312983 28659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:24.313158 28659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:24.322327 28659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:24.323550 28659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:24.325434 28659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:24.338376 28665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:24.338384 28669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:24.338404 28667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:24.339203 28659 server_base.cc:1034] running on GCE node
I20260811 18:54:24.339787 28659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:24.340677 28659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:24.341934 28659 hybrid_clock.cc:648] HybridClock initialized: now 1786474464341889 us; error 54 us; skew 500 ppm
I20260811 18:54:24.342245 28659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:24.344455 28659 webserver.cc:460] Webserver started at http://127.19.155.194:37275/ using document root <none> and password file <none>
I20260811 18:54:24.345101 28659 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:24.345233 28659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:24.345562 28659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:24.348336 28659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "4062536197c3423e897f799e04945fa6"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "f7ed09c06d9f321ac50a876168d02e53"
server_key_iv: "1ccff9edaec80db42b706711d3281742"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.349135 28659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "4062536197c3423e897f799e04945fa6"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "f7ed09c06d9f321ac50a876168d02e53"
server_key_iv: "1ccff9edaec80db42b706711d3281742"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.354039 28659 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 18:54:24.357316 28683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.358505 28659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 18:54:24.358680 28659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "4062536197c3423e897f799e04945fa6"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "f7ed09c06d9f321ac50a876168d02e53"
server_key_iv: "1ccff9edaec80db42b706711d3281742"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.358904 28659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:24.364292 28659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:24.365036 28659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:24.365312 28659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:24.366189 28659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:24.367527 28659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:24.367643 28659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.367782 28659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:24.367890 28659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.401044 28659 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:43791
I20260811 18:54:24.401095 28866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:43791 every 8 connection(s)
I20260811 18:54:24.402369 28659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:24.406577 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 28659
I20260811 18:54:24.406766 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:24.407274 20079 external_mini_cluster.cc:1428] Setting key ddc723ea47b51830ef20ad4b42fa0479
I20260811 18:54:24.410112 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--builtin_ntp_servers=127.19.155.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 18:54:24.411069 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.405021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:52185 (local address 127.19.155.254:40943)
0811 18:54:24.405206 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.405213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.406833 (+ 1620us) server_negotiation.cc:407] Connection header received
0811 18:54:24.408749 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.408764 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.408851 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.408963 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.410281 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.410291 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.410296 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.410312 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.410343 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.410355 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.410477 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.410682 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.410750 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:54:24.411924 28873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.405556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40943 (local address 127.19.155.194:52185)
0811 18:54:24.406670 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:24.406729 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:24.408476 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:24.409192 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:24.409200 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:24.409291 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:24.409987 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:24.409989 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:24.410026 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:24.410106 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:24.410453 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:24.410463 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:24.410471 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:54:24.410763 (+ 292us) client_negotiation.cc:240] Negotiation successful
0811 18:54:24.411029 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":371,"threads_started":1}
I20260811 18:54:24.413367 28868 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40943
I20260811 18:54:24.413676 28868 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:24.414338 28868 heartbeater.cc:511] Master 127.19.155.254:40943 requested a full tablet report, sending...
I20260811 18:54:24.415904 28348 ts_manager.cc:194] Registered new tserver with Master: 4062536197c3423e897f799e04945fa6 (127.19.155.194:43791)
W20260811 18:54:24.739670 28874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:24.739920 28874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:24.740008 28874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:24.747071 28874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:24.747172 28874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:24.747278 28874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:24.756147 28874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:24.757373 28874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:24.759142 28874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:24.772208 28883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:24.772306 28880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:24.772284 28881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:24.773221 28874 server_base.cc:1034] running on GCE node
I20260811 18:54:24.773811 28874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:24.774711 28874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:24.775913 28874 hybrid_clock.cc:648] HybridClock initialized: now 1786474464775851 us; error 54 us; skew 500 ppm
I20260811 18:54:24.776288 28874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:24.778656 28874 webserver.cc:460] Webserver started at http://127.19.155.195:40897/ using document root <none> and password file <none>
I20260811 18:54:24.779452 28874 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:24.779587 28874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:24.779935 28874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:24.783028 28874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "7591264a5c60401a97fd57cc6eb56649"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "5c080f8e265885d1dc79b0e0e0857833"
server_key_iv: "786abb20aa63cc8a4129f7857353e8e1"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.783869 28874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "7591264a5c60401a97fd57cc6eb56649"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "5c080f8e265885d1dc79b0e0e0857833"
server_key_iv: "786abb20aa63cc8a4129f7857353e8e1"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.788785 28874 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:54:24.792165 28891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.793490 28874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:54:24.793624 28874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "7591264a5c60401a97fd57cc6eb56649"
format_stamp: "Formatted at 2026-08-11 18:54:24 on dist-test-slave-1nl6"
server_key: "5c080f8e265885d1dc79b0e0e0857833"
server_key_iv: "786abb20aa63cc8a4129f7857353e8e1"
server_key_version: "encryptionkey@0"
I20260811 18:54:24.793797 28874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:24.799444 28874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:24.800141 28874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:24.800366 28874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:24.801170 28874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:24.802539 28874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:24.802654 28874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.802773 28874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:24.802870 28874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:24.836661 28874 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:43951
I20260811 18:54:24.836737 29085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:43951 every 8 connection(s)
I20260811 18:54:24.837977 28874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:24.843799 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 28874
I20260811 18:54:24.843966 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:24.844591 20079 external_mini_cluster.cc:1428] Setting key 762225a40c72affbf6539acacaaf5219
I20260811 18:54:24.846690 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.840628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:48403 (local address 127.19.155.254:40943)
0811 18:54:24.840853 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.840859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.842237 (+ 1378us) server_negotiation.cc:407] Connection header received
0811 18:54:24.844197 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.844202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.844254 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.844351 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.845895 (+ 1544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.845902 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.845907 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.845924 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.845961 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.845977 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.846118 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.846327 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.846390 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:54:24.847747 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.841215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40943 (local address 127.19.155.195:48403)
0811 18:54:24.842091 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:24.842135 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:24.843902 (+ 1767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:24.844615 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:24.844627 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:24.844743 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:24.845551 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:24.845554 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:24.845604 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:24.845704 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:24.846088 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:24.846101 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:24.846109 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:54:24.846409 (+ 300us) client_negotiation.cc:240] Negotiation successful
0811 18:54:24.846647 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":269,"threads_started":1}
I20260811 18:54:24.848903 29086 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40943
I20260811 18:54:24.849195 29086 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:24.849787 29086 heartbeater.cc:511] Master 127.19.155.254:40943 requested a full tablet report, sending...
I20260811 18:54:24.851151 28348 ts_manager.cc:194] Registered new tserver with Master: 7591264a5c60401a97fd57cc6eb56649 (127.19.155.195:43951)
I20260811 18:54:24.859948 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:54:24.867192 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.864578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41204 (local address 127.19.155.254:40943)
0811 18:54:24.864829 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.864864 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.865315 (+ 451us) server_negotiation.cc:407] Connection header received
0811 18:54:24.865533 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.865541 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.865614 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.865724 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.866676 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.866679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.866682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.866694 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.866718 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.866728 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.866819 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.866859 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.866953 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 18:54:24.870981 28348 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:24.877888 28348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:24.894584 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.889965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:44271 (local address 127.0.0.1:59368)
0811 18:54:24.891159 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:24.891215 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:24.891441 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:24.892316 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:24.892323 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:24.892409 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:24.893203 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:24.893206 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:24.893234 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:24.893315 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:24.893787 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:24.893800 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:24.893810 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:54:24.894014 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 18:54:24.894111 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":716,"threads_started":1}
I20260811 18:54:24.895046 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.889994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59368 (local address 127.19.155.193:44271)
0811 18:54:24.890508 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.890519 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.891321 (+ 802us) server_negotiation.cc:407] Connection header received
0811 18:54:24.891625 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.891634 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.891855 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.891986 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.893470 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.893480 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.893495 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.893519 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.893577 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.893598 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.893726 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.894571 (+ 845us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.894675 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":331,"threads_started":1}
I20260811 18:54:24.897652 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.892340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50744 (local address 127.19.155.195:43951)
0811 18:54:24.893749 (+ 1409us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.893758 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.894277 (+ 519us) server_negotiation.cc:407] Connection header received
0811 18:54:24.894515 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.894523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.894681 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.894818 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.895924 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.895932 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.895944 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.895960 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.896016 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.896041 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.896244 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.896904 (+ 660us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.897003 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1212,"thread_start_us":567,"threads_started":1}
I20260811 18:54:24.897796 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.891660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:43951 (local address 127.0.0.1:50744)
0811 18:54:24.894173 (+ 2513us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:24.894189 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:24.894362 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:24.894890 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:24.894914 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:24.894937 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:24.895666 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:24.895670 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:24.895685 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:24.895731 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:24.896146 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:24.896151 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:24.896156 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:54:24.897312 (+ 1156us) client_negotiation.cc:240] Negotiation successful
0811 18:54:24.897363 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2398,"thread_start_us":2238,"threads_started":1}
I20260811 18:54:24.898384 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.890026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:43791 (local address 127.0.0.1:53552)
0811 18:54:24.891989 (+ 1963us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:24.892007 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:24.892093 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:24.895455 (+ 3362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:24.895462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:24.895492 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:24.896153 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:24.896157 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:24.896173 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:24.896220 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:24.897507 (+ 1287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:24.897514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:24.897522 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:54:24.897671 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 18:54:24.897730 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1815,"spinlock_wait_cycles":1280,"thread_start_us":1209,"threads_started":1}
I20260811 18:54:24.899047 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:24.890739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53552 (local address 127.19.155.194:43791)
0811 18:54:24.894358 (+ 3619us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:24.894364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:24.894388 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:54:24.894471 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:24.894479 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:24.895133 (+ 654us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:24.895924 (+ 791us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:24.897242 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:24.897251 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:24.897264 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:24.897293 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:24.897344 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:24.897363 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:24.898509 (+ 1146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:24.898595 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:54:24.898685 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3446,"thread_start_us":2637,"threads_started":1}
I20260811 18:54:24.899191 28546 tablet_service.cc:1467] Processing CreateTablet for tablet 00d639de07e54f068438c98f6219c22b (DEFAULT_TABLE table=test-table [id=ead77493579a4722a84e3970bdb86ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:24.900529 28546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d639de07e54f068438c98f6219c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:24.901839 28973 tablet_service.cc:1467] Processing CreateTablet for tablet 00d639de07e54f068438c98f6219c22b (DEFAULT_TABLE table=test-table [id=ead77493579a4722a84e3970bdb86ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:24.902562 28757 tablet_service.cc:1467] Processing CreateTablet for tablet 00d639de07e54f068438c98f6219c22b (DEFAULT_TABLE table=test-table [id=ead77493579a4722a84e3970bdb86ad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:24.903352 28973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d639de07e54f068438c98f6219c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:24.903929 28757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d639de07e54f068438c98f6219c22b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:24.912873 29122 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Bootstrap starting.
I20260811 18:54:24.915723 29122 tablet_bootstrap.cc:654] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:24.916729 29122 log.cc:824] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:24.919373 29125 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Bootstrap starting.
I20260811 18:54:24.920171 29122 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: No bootstrap required, opened a new log
I20260811 18:54:24.920572 29122 ts_tablet_manager.cc:1397] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260811 18:54:24.923076 29125 tablet_bootstrap.cc:654] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:24.923727 29124 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Bootstrap starting.
I20260811 18:54:24.924275 29125 log.cc:824] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:24.927166 29124 tablet_bootstrap.cc:654] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:24.928396 29124 log.cc:824] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:24.929960 29125 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: No bootstrap required, opened a new log
I20260811 18:54:24.930220 29125 ts_tablet_manager.cc:1397] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260811 18:54:24.930835 29124 tablet_bootstrap.cc:492] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: No bootstrap required, opened a new log
I20260811 18:54:24.931109 29124 ts_tablet_manager.cc:1397] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 18:54:24.931547 29122 raft_consensus.cc:348] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.931984 29122 raft_consensus.cc:374] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:24.932080 29122 raft_consensus.cc:729] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 350848aaedff49c5955e592e36a57f2a, State: Initialized, Role: FOLLOWER
I20260811 18:54:24.932713 29122 consensus_queue.cc:260] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.934885 28652 heartbeater.cc:503] Master 127.19.155.254:40943 was elected leader, sending a full tablet report...
I20260811 18:54:24.935591 29122 ts_tablet_manager.cc:1428] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Time spent starting tablet: real 0.015s user 0.012s sys 0.002s
I20260811 18:54:24.939344 29125 raft_consensus.cc:348] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.939795 29125 raft_consensus.cc:374] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:24.939910 29125 raft_consensus.cc:729] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7591264a5c60401a97fd57cc6eb56649, State: Initialized, Role: FOLLOWER
I20260811 18:54:24.940557 29125 consensus_queue.cc:260] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.941728 29086 heartbeater.cc:503] Master 127.19.155.254:40943 was elected leader, sending a full tablet report...
I20260811 18:54:24.942129 29125 ts_tablet_manager.cc:1428] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260811 18:54:24.942306 29124 raft_consensus.cc:348] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.942658 29124 raft_consensus.cc:374] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:24.942766 29124 raft_consensus.cc:729] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4062536197c3423e897f799e04945fa6, State: Initialized, Role: FOLLOWER
I20260811 18:54:24.943434 29124 consensus_queue.cc:260] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:24.944587 28868 heartbeater.cc:503] Master 127.19.155.254:40943 was elected leader, sending a full tablet report...
I20260811 18:54:24.945163 29124 ts_tablet_manager.cc:1428] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Time spent starting tablet: real 0.014s user 0.011s sys 0.000s
W20260811 18:54:24.963172 28653 tablet.cc:2369] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:25.071339 29131 raft_consensus.cc:482] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:25.071663 29131 raft_consensus.cc:504] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:25.073421 29131 leader_election.cc:288] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 350848aaedff49c5955e592e36a57f2a (127.19.155.193:44271), 7591264a5c60401a97fd57cc6eb56649 (127.19.155.195:43951)
I20260811 18:54:25.077301 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.073778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:36873 (local address 127.19.155.193:44271)
0811 18:54:25.074021 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.074030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.074729 (+ 699us) server_negotiation.cc:407] Connection header received
0811 18:54:25.075040 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.075049 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.075119 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.075214 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.076615 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.076622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.076628 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.076650 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.076695 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.076717 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.076835 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.076924 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.076993 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:54:25.077390 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.073778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:44271 (local address 127.19.155.194:36873)
0811 18:54:25.074605 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:25.074629 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:25.074842 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:25.075447 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:25.075454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:25.075488 (+ 34us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:25.076302 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:25.076309 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:25.076337 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:25.076409 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:25.076808 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:25.076813 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:25.076818 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:54:25.076964 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 18:54:25.077014 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":439,"threads_started":1}
I20260811 18:54:25.078577 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.074704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37943 (local address 127.19.155.195:43951)
0811 18:54:25.074960 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.074969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.075534 (+ 565us) server_negotiation.cc:407] Connection header received
0811 18:54:25.075718 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.075724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.075785 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.075886 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.077935 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.077943 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.077951 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.077975 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.078016 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.078033 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.078160 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.078245 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.078308 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:54:25.078732 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.074604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:43951 (local address 127.19.155.194:37943)
0811 18:54:25.075428 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:25.075442 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:25.075576 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:25.076195 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:25.076204 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:25.076231 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:25.077636 (+ 1405us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:54:25.077642 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:25.077662 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:54:25.077718 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:25.078129 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:25.078133 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:25.078140 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:54:25.078270 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:54:25.078315 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":540,"threads_started":1}
I20260811 18:54:25.078624 28580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d639de07e54f068438c98f6219c22b" candidate_uuid: "4062536197c3423e897f799e04945fa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350848aaedff49c5955e592e36a57f2a" is_pre_election: true
I20260811 18:54:25.079329 28580 raft_consensus.cc:2454] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4062536197c3423e897f799e04945fa6 in term 0.
I20260811 18:54:25.079686 29009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d639de07e54f068438c98f6219c22b" candidate_uuid: "4062536197c3423e897f799e04945fa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7591264a5c60401a97fd57cc6eb56649" is_pre_election: true
I20260811 18:54:25.080262 28691 leader_election.cc:302] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 350848aaedff49c5955e592e36a57f2a, 4062536197c3423e897f799e04945fa6; no voters:
I20260811 18:54:25.080329 29009 raft_consensus.cc:2454] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4062536197c3423e897f799e04945fa6 in term 0.
I20260811 18:54:25.080694 29131 raft_consensus.cc:2781] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:25.080878 29131 raft_consensus.cc:482] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:25.081002 29131 raft_consensus.cc:3037] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:25.084884 29131 raft_consensus.cc:504] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:25.085683 29131 leader_election.cc:288] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [CANDIDATE]: Term 1 election: Requested vote from peers 350848aaedff49c5955e592e36a57f2a (127.19.155.193:44271), 7591264a5c60401a97fd57cc6eb56649 (127.19.155.195:43951)
I20260811 18:54:25.086099 28580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d639de07e54f068438c98f6219c22b" candidate_uuid: "4062536197c3423e897f799e04945fa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "350848aaedff49c5955e592e36a57f2a"
I20260811 18:54:25.086151 29009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d639de07e54f068438c98f6219c22b" candidate_uuid: "4062536197c3423e897f799e04945fa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7591264a5c60401a97fd57cc6eb56649"
I20260811 18:54:25.086365 29009 raft_consensus.cc:3037] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:25.086342 28580 raft_consensus.cc:3037] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:25.088761 29009 raft_consensus.cc:2454] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4062536197c3423e897f799e04945fa6 in term 1.
I20260811 18:54:25.089223 28691 leader_election.cc:302] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4062536197c3423e897f799e04945fa6, 7591264a5c60401a97fd57cc6eb56649; no voters:
I20260811 18:54:25.089483 29131 raft_consensus.cc:2781] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 18:54:25.089738 29087 tablet.cc:2369] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:25.090127 28580 raft_consensus.cc:2454] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4062536197c3423e897f799e04945fa6 in term 1.
I20260811 18:54:25.090925 29131 raft_consensus.cc:686] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 1 LEADER]: Becoming Leader. State: Replica: 4062536197c3423e897f799e04945fa6, State: Running, Role: LEADER
I20260811 18:54:25.091447 29131 consensus_queue.cc:237] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } }
I20260811 18:54:25.096014 28347 catalog_manager.cc:5495] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4062536197c3423e897f799e04945fa6 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "4062536197c3423e897f799e04945fa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4062536197c3423e897f799e04945fa6" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 43791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:25.140229 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.137791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.19.155.194:43791)
0811 18:54:25.137983 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.137990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.138185 (+ 195us) server_negotiation.cc:407] Connection header received
0811 18:54:25.138432 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.138436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.138521 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.138630 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.139640 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.139645 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.139648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.139663 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.139696 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.139708 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.139840 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.139927 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.139988 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 18:54:25.148386 28580 raft_consensus.cc:1261] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 1 FOLLOWER]: Refusing update from remote peer 4062536197c3423e897f799e04945fa6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:25.148475 29009 raft_consensus.cc:1261] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 1 FOLLOWER]: Refusing update from remote peer 4062536197c3423e897f799e04945fa6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:25.149369 29131 consensus_queue.cc:1035] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "350848aaedff49c5955e592e36a57f2a" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 44271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:25.149719 29134 consensus_queue.cc:1035] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7591264a5c60401a97fd57cc6eb56649" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 43951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:54:25.154395 28869 tablet.cc:2369] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:25.167752 29139 mvcc.cc:205] Tried to move back new op lower bound from 7317399409237733376 to 7317399409019162624. Current Snapshot: MvccSnapshot[applied={T|T < 7317399409237733376}]
I20260811 18:54:25.168663 29144 mvcc.cc:205] Tried to move back new op lower bound from 7317399409237733376 to 7317399409019162624. Current Snapshot: MvccSnapshot[applied={T|T < 7317399409237733376}]
I20260811 18:54:25.192346 28347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:25.192759 28347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:25.196203 28347 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc31fb9152da417a836d2e1caea43c73: Sending DeleteTablet for 3 replicas of tablet 00d639de07e54f068438c98f6219c22b
I20260811 18:54:25.197350 28546 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d639de07e54f068438c98f6219c22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:25 UTC) from {username='slave'} at 127.0.0.1:59368
I20260811 18:54:25.198379 29156 tablet_replica.cc:330] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: stopping tablet replica
I20260811 18:54:25.198397 28757 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d639de07e54f068438c98f6219c22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:25 UTC) from {username='slave'} at 127.0.0.1:53552
I20260811 18:54:25.199141 29156 raft_consensus.cc:2229] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:25.199831 29156 raft_consensus.cc:2258] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:25.202086 29156 ts_tablet_manager.cc:1905] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:25.204639 28973 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d639de07e54f068438c98f6219c22b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:25 UTC) from {username='slave'} at 127.0.0.1:50744
I20260811 18:54:25.210987 29156 ts_tablet_manager.cc:1918] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:25.211266 29156 log.cc:1196] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/00d639de07e54f068438c98f6219c22b
I20260811 18:54:25.211920 29156 ts_tablet_manager.cc:1939] T 00d639de07e54f068438c98f6219c22b P 350848aaedff49c5955e592e36a57f2a: Deleting consensus metadata
I20260811 18:54:25.214833 28320 catalog_manager.cc:4841] TS 350848aaedff49c5955e592e36a57f2a (127.19.155.193:44271): tablet 00d639de07e54f068438c98f6219c22b (table test-table [id=ead77493579a4722a84e3970bdb86ad9]) successfully deleted
I20260811 18:54:25.215363 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 28445
I20260811 18:54:25.225975 29159 tablet_replica.cc:330] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: stopping tablet replica
I20260811 18:54:25.226555 29159 raft_consensus.cc:2229] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:25.227257 29159 raft_consensus.cc:2258] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:25.228343 29158 tablet_replica.cc:330] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: stopping tablet replica
I20260811 18:54:25.228858 29158 raft_consensus.cc:2229] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:25.229660 29158 raft_consensus.cc:2258] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:25.232328 29159 ts_tablet_manager.cc:1905] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:25.232865 29158 ts_tablet_manager.cc:1905] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:25.239626 29159 ts_tablet_manager.cc:1918] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:25.239809 29159 log.cc:1196] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/00d639de07e54f068438c98f6219c22b
I20260811 18:54:25.240326 29158 ts_tablet_manager.cc:1918] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:25.240381 29159 ts_tablet_manager.cc:1939] T 00d639de07e54f068438c98f6219c22b P 7591264a5c60401a97fd57cc6eb56649: Deleting consensus metadata
I20260811 18:54:25.240561 29158 log.cc:1196] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/00d639de07e54f068438c98f6219c22b
I20260811 18:54:25.241168 29158 ts_tablet_manager.cc:1939] T 00d639de07e54f068438c98f6219c22b P 4062536197c3423e897f799e04945fa6: Deleting consensus metadata
I20260811 18:54:25.242336 28320 catalog_manager.cc:4841] TS 7591264a5c60401a97fd57cc6eb56649 (127.19.155.195:43951): tablet 00d639de07e54f068438c98f6219c22b (table test-table [id=ead77493579a4722a84e3970bdb86ad9]) successfully deleted
I20260811 18:54:25.242878 28316 catalog_manager.cc:4841] TS 4062536197c3423e897f799e04945fa6 (127.19.155.194:43791): tablet 00d639de07e54f068438c98f6219c22b (table test-table [id=ead77493579a4722a84e3970bdb86ad9]) successfully deleted
I20260811 18:54:25.245388 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.216585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.19.155.193:44271)
0811 18:54:25.216753 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.216762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.230773 (+ 14011us) server_negotiation.cc:407] Connection header received
0811 18:54:25.243397 (+ 12624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.243405 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.243529 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.243662 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.244680 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.244686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.244691 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.244714 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.244753 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.244765 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.244906 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.244995 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.245071 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:54:25.246192 28645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:25.342024 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 28445
I20260811 18:54:25.368953 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 28659
I20260811 18:54:25.376650 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.369930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53570 (local address 127.19.155.194:43791)
0811 18:54:25.370141 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.370147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.370175 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:54:25.370266 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.370272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.370334 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.370445 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.376000 (+ 5555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.376006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.376011 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.376030 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.376070 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.376086 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.376234 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.376289 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.376346 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:54:25.377430 28859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:25.481279 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 28659
I20260811 18:54:25.509006 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 28874
I20260811 18:54:25.511687 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:25.509771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.19.155.195:43951)
0811 18:54:25.509948 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:25.509952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:25.509971 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:25.510133 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:25.510137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:25.510228 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:25.510323 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:25.511175 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:25.511180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:25.511184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:25.511198 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:25.511230 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:25.511242 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:25.511357 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:25.511422 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 18:54:25.511467 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:54:25.512322 29077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:25.598277 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 28874
I20260811 18:54:25.625360 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 28289
I20260811 18:54:25.626503 28396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:25.731114 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 28289
2026-08-11T18:54:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2776 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 18:54:25.782976 20079 mini_oidc.cc:152] Starting JWKS server
I20260811 18:54:25.786186 20079 webserver.cc:460] Webserver started at https://127.0.0.1:35359/ using document root <none> and password file <none>
I20260811 18:54:25.786540 20079 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:54:25.787308 20079 webserver.cc:460] Webserver started at http://127.0.0.1:37361/ using document root <none> and password file <none>
2026-08-11T18:54:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:25Z Disabled control of system clock
I20260811 18:54:25.819211 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:39217
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:39217
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35359/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/testchainca.cert with env {}
W20260811 18:54:26.150629 29181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:26.150952 29181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:26.151079 29181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:26.158198 29181 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:26.158295 29181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:26.158334 29181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:26.158382 29181 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:26.158419 29181 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:54:26.158480 29181 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:54:26.158521 29181 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35359/jwks.json
I20260811 18:54:26.168167 29181 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:39217
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:39217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35359/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:26.169328 29181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:26.170542 29181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:26.182354 29194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:26.182382 29192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:26.182385 29196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:26.183164 29181 server_base.cc:1034] running on GCE node
I20260811 18:54:26.183985 29181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:26.185309 29181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:26.186637 29181 hybrid_clock.cc:648] HybridClock initialized: now 1786474466186520 us; error 81 us; skew 500 ppm
I20260811 18:54:26.187083 29181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:26.189399 29181 webserver.cc:460] Webserver started at http://127.19.155.254:39711/ using document root <none> and password file <none>
I20260811 18:54:26.190073 29181 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:26.190197 29181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:26.190538 29181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:26.193449 29181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "d904d8f2fb7c443bae3bba3a6072dc2b"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "5496b892978f369a9a44a6233a014a2d"
server_key_iv: "03b90752f6c52066d77f6b5d69b9d983"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.194231 29181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "d904d8f2fb7c443bae3bba3a6072dc2b"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "5496b892978f369a9a44a6233a014a2d"
server_key_iv: "03b90752f6c52066d77f6b5d69b9d983"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.199211 29181 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:54:26.202376 29204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:26.203685 29181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:26.203890 29181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "d904d8f2fb7c443bae3bba3a6072dc2b"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "5496b892978f369a9a44a6233a014a2d"
server_key_iv: "03b90752f6c52066d77f6b5d69b9d983"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.204100 29181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:26.228662 29181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:26.229431 29181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:26.229743 29181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:26.247567 29295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:39217 every 8 connection(s)
I20260811 18:54:26.247568 29181 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:39217
I20260811 18:54:26.248805 29181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:26.252449 29296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:26.258040 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 29181
I20260811 18:54:26.258255 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:26.258868 20079 external_mini_cluster.cc:1428] Setting key 7ebc92b8bda51cb0b06e8c09102b6007
I20260811 18:54:26.262624 29296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b: Bootstrap starting.
I20260811 18:54:26.265887 29296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:26.267102 29296 log.cc:824] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:26.269780 29296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b: No bootstrap required, opened a new log
I20260811 18:54:26.272523 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:26.260869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59302 (local address 127.19.155.254:39217)
0811 18:54:26.261837 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:26.261847 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:26.261886 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:54:26.263644 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:26.263666 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:26.264088 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:26.264387 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:26.265052 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.266300 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.268144 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.268792 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.269006 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:26.270260 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:26.270268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:26.270281 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:26.270788 (+ 507us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:26.270859 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:26.270879 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:26.271028 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:26.271335 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 18:54:26.271606 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":360,"threads_started":1}
I20260811 18:54:26.276167 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:54:26.277613 29296 raft_consensus.cc:348] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } }
I20260811 18:54:26.277940 29296 raft_consensus.cc:374] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:26.278038 29296 raft_consensus.cc:729] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d904d8f2fb7c443bae3bba3a6072dc2b, State: Initialized, Role: FOLLOWER
I20260811 18:54:26.278648 29296 consensus_queue.cc:260] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } }
I20260811 18:54:26.278945 29296 raft_consensus.cc:388] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:26.279117 29296 raft_consensus.cc:482] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:26.279306 29296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:26.281322 29296 raft_consensus.cc:504] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } }
I20260811 18:54:26.281797 29296 leader_election.cc:302] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d904d8f2fb7c443bae3bba3a6072dc2b; no voters:
I20260811 18:54:26.282362 29296 leader_election.cc:288] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:26.282523 29304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:26.283314 29304 raft_consensus.cc:686] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [term 1 LEADER]: Becoming Leader. State: Replica: d904d8f2fb7c443bae3bba3a6072dc2b, State: Running, Role: LEADER
I20260811 18:54:26.283890 29304 consensus_queue.cc:237] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } }
I20260811 18:54:26.284399 29296 sys_catalog.cc:564] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:26.286952 29306 sys_catalog.cc:455] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d904d8f2fb7c443bae3bba3a6072dc2b. Latest consensus state: current_term: 1 leader_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } } }
I20260811 18:54:26.287458 29306 sys_catalog.cc:458] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:26.287735 29305 sys_catalog.cc:455] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d904d8f2fb7c443bae3bba3a6072dc2b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 39217 } } }
I20260811 18:54:26.288165 29305 sys_catalog.cc:458] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:26.289542 29315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:26.293695 29315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:26.301729 29315 catalog_manager.cc:1347] Generated new cluster ID: f6b9ded1a28b4987b5986d6b75281408
I20260811 18:54:26.301841 29315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:26.330037 29315 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:26.331712 29315 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:26.338277 29315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d904d8f2fb7c443bae3bba3a6072dc2b: Generated new TSK 0
I20260811 18:54:26.339186 29315 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:54:26.380776 29339 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 18:54:26.380985 29339 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:54:26.381891 29302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:26.359298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59314 (local address 127.19.155.254:39217)
0811 18:54:26.359499 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:26.359508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:26.360123 (+ 615us) server_negotiation.cc:407] Connection header received
0811 18:54:26.360484 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:26.360488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:26.360562 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:26.360693 (+ 131us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:54:26.361335 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.362051 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.364272 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.364725 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.364817 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:26.365526 (+ 709us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:54:26.381434 (+ 15908us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:54:26.381697 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59314: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 18:54:26.382040 29302 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59314: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 18:54:26.384037 29338 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:26.359315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:39217 (local address 127.0.0.1:59314)
0811 18:54:26.359986 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:26.360005 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:26.360190 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:26.360755 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:26.360761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:26.360774 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:54:26.361176 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:26.361187 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.362186 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.362191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:26.364111 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:26.364129 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:26.364925 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:26.364933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:26.365203 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:26.365282 (+ 79us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:54:26.381688 (+ 16406us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:54:26.382027 (+ 339us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.155.254:39217: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":325,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.155.254:39217: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 18:54:26.385807 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 29181
I20260811 18:54:26.386847 29288 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:26.479655 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 29181
2026-08-11T18:54:26Z chronyd exiting
I20260811 18:54:26.536000 20079 test_util.cc:175] -----------------------------------------------
I20260811 18:54:26.536144 20079 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474422014372-20079-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (758 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 18:54:26.539999 20079 mini_oidc.cc:152] Starting JWKS server
I20260811 18:54:26.541884 20079 webserver.cc:460] Webserver started at https://127.0.0.1:39949/ using document root <none> and password file <none>
I20260811 18:54:26.542116 20079 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:54:26.542758 20079 webserver.cc:460] Webserver started at http://127.0.0.1:41703/ using document root <none> and password file <none>
2026-08-11T18:54:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:26Z Disabled control of system clock
I20260811 18:54:26.577327 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:37083
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:41289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:37083
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39949/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/testchainca.cert with env {}
W20260811 18:54:26.910531 29347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:26.910799 29347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:26.910882 29347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:26.917762 29347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:26.917862 29347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:26.917901 29347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:26.917958 29347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:26.918000 29347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:54:26.918053 29347 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:54:26.918093 29347 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39949/jwks.json
I20260811 18:54:26.927768 29347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:37083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:37083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39949/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:26.928979 29347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:26.930217 29347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:26.941936 29366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:26.942152 29359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:26.942109 29360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:26.942987 29347 server_base.cc:1034] running on GCE node
I20260811 18:54:26.943754 29347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:26.945156 29347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:26.946389 29347 hybrid_clock.cc:648] HybridClock initialized: now 1786474466946343 us; error 76 us; skew 500 ppm
I20260811 18:54:26.946738 29347 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:26.949150 29347 webserver.cc:460] Webserver started at http://127.19.155.254:36993/ using document root <none> and password file <none>
I20260811 18:54:26.949855 29347 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:26.949996 29347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:26.950340 29347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:26.953254 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "6f77a3dad2b44b13aa3a4efbffc3baab"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "4efbc0f45fc8b0780f1dac232b512bd2"
server_key_iv: "08efa22c37f7ea309a348ad0402f2497"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.954064 29347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "6f77a3dad2b44b13aa3a4efbffc3baab"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "4efbc0f45fc8b0780f1dac232b512bd2"
server_key_iv: "08efa22c37f7ea309a348ad0402f2497"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.959055 29347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 18:54:26.962291 29378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:26.963584 29347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:26.963778 29347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "6f77a3dad2b44b13aa3a4efbffc3baab"
format_stamp: "Formatted at 2026-08-11 18:54:26 on dist-test-slave-1nl6"
server_key: "4efbc0f45fc8b0780f1dac232b512bd2"
server_key_iv: "08efa22c37f7ea309a348ad0402f2497"
server_key_version: "encryptionkey@0"
I20260811 18:54:26.964112 29347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:26.991389 29347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:26.992285 29347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:26.992616 29347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:27.011109 29347 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:37083
I20260811 18:54:27.011085 29476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:37083 every 8 connection(s)
I20260811 18:54:27.012495 29347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:27.016337 29477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:27.016952 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 29347
I20260811 18:54:27.017181 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:27.017853 20079 external_mini_cluster.cc:1428] Setting key 64d1eade75e29a5225378609017b01f8
I20260811 18:54:27.032191 29477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab: Bootstrap starting.
I20260811 18:54:27.034034 29480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:27.019590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54642 (local address 127.19.155.254:37083)
0811 18:54:27.020768 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:27.020785 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:27.020839 (+ 54us) server_negotiation.cc:407] Connection header received
0811 18:54:27.023732 (+ 2893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:27.023763 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:27.024403 (+ 640us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:27.024870 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:27.025438 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.027335 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.028643 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.029763 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.029940 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.031108 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:27.031120 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:27.031139 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:27.031858 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:27.031962 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:27.031989 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:27.032115 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:27.032392 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:54:27.032720 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":401,"threads_started":1}
I20260811 18:54:27.036160 29477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:27.037458 29477 log.cc:824] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:27.038359 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:54:27.040987 29477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab: No bootstrap required, opened a new log
I20260811 18:54:27.048561 29477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } }
I20260811 18:54:27.048967 29477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:27.049045 29477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f77a3dad2b44b13aa3a4efbffc3baab, State: Initialized, Role: FOLLOWER
I20260811 18:54:27.049610 29477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } }
I20260811 18:54:27.049829 29477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:27.049930 29477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:27.050053 29477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:27.052234 29477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } }
I20260811 18:54:27.052685 29477 leader_election.cc:302] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f77a3dad2b44b13aa3a4efbffc3baab; no voters:
I20260811 18:54:27.053309 29477 leader_election.cc:288] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:27.053524 29482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:27.054523 29482 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [term 1 LEADER]: Becoming Leader. State: Replica: 6f77a3dad2b44b13aa3a4efbffc3baab, State: Running, Role: LEADER
I20260811 18:54:27.055109 29482 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } }
I20260811 18:54:27.055608 29477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:27.057737 29484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f77a3dad2b44b13aa3a4efbffc3baab. Latest consensus state: current_term: 1 leader_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } } }
I20260811 18:54:27.058075 29484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:27.058308 29483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f77a3dad2b44b13aa3a4efbffc3baab" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37083 } } }
I20260811 18:54:27.058650 29483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:27.062299 29493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:27.067092 29493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:27.076433 29493 catalog_manager.cc:1347] Generated new cluster ID: 00ea31afb6d14c17a5e5f290004b920d
I20260811 18:54:27.076570 29493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:27.090785 29493 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:27.092536 29493 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:27.102928 29493 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f77a3dad2b44b13aa3a4efbffc3baab: Generated new TSK 0
I20260811 18:54:27.103894 29493 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:54:27.150173 29518 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 18:54:27.150311 29518 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:54:27.151646 29480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:27.131187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54656 (local address 127.19.155.254:37083)
0811 18:54:27.131400 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:27.131407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:27.131912 (+ 505us) server_negotiation.cc:407] Connection header received
0811 18:54:27.132145 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:27.132153 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:27.132247 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:27.132413 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:54:27.132873 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.134010 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.135437 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.136225 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.136388 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.136852 (+ 464us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:54:27.150946 (+ 14094us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:54:27.151336 (+ 390us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 18:54:27.151674 29517 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:27.131127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:37083 (local address 127.0.0.1:54656)
0811 18:54:27.131809 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:27.131826 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:27.131951 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:27.132437 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:27.132441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:27.132450 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:54:27.132699 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:27.132706 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.134155 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.134159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:27.135294 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:27.135306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.136423 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.136428 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:27.136550 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.136584 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:54:27.151170 (+ 14586us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:54:27.151378 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.155.254:37083: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":384,"threads_started":1}
W20260811 18:54:27.151778 29480 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 18:54:27.153069 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 29347
I20260811 18:54:27.154227 29468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:27.246035 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 29347
2026-08-11T18:54:27Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (772 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 18:54:27.313006 20079 mini_oidc.cc:152] Starting JWKS server
I20260811 18:54:27.314982 20079 webserver.cc:460] Webserver started at https://127.0.0.1:42897/ using document root <none> and password file <none>
I20260811 18:54:27.315255 20079 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:54:27.315888 20079 webserver.cc:460] Webserver started at http://127.0.0.1:45777/ using document root <none> and password file <none>
2026-08-11T18:54:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:27Z Disabled control of system clock
I20260811 18:54:27.349823 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:32895
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:44741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:32895
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42897/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:54:27.674628 29529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:27.675004 29529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:27.675166 29529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:27.682302 29529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:27.682446 29529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:27.682541 29529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:27.682650 29529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:27.682735 29529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:54:27.682824 29529 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:54:27.682922 29529 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42897/jwks.json
I20260811 18:54:27.691869 29529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:32895
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:32895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42897/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:27.693224 29529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:27.695052 29529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:27.707360 29540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:27.707329 29542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:27.707619 29539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:27.708285 29529 server_base.cc:1034] running on GCE node
I20260811 18:54:27.709096 29529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:27.710574 29529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:27.711845 29529 hybrid_clock.cc:648] HybridClock initialized: now 1786474467711810 us; error 48 us; skew 500 ppm
I20260811 18:54:27.712261 29529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:27.714516 29529 webserver.cc:460] Webserver started at http://127.19.155.254:39777/ using document root <none> and password file <none>
I20260811 18:54:27.715518 29529 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:27.715652 29529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:27.716054 29529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:27.719111 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "32964bdb2900479bb3cdc75863a5a9a0"
format_stamp: "Formatted at 2026-08-11 18:54:27 on dist-test-slave-1nl6"
server_key: "9fb37cd2dd2cdfcd31bfd7fdc1390c60"
server_key_iv: "0c6afef00044089e4ef1002829795926"
server_key_version: "encryptionkey@0"
I20260811 18:54:27.719939 29529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "32964bdb2900479bb3cdc75863a5a9a0"
format_stamp: "Formatted at 2026-08-11 18:54:27 on dist-test-slave-1nl6"
server_key: "9fb37cd2dd2cdfcd31bfd7fdc1390c60"
server_key_iv: "0c6afef00044089e4ef1002829795926"
server_key_version: "encryptionkey@0"
I20260811 18:54:27.725562 29529 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:27.729074 29551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:27.730441 29529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:27.730643 29529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "32964bdb2900479bb3cdc75863a5a9a0"
format_stamp: "Formatted at 2026-08-11 18:54:27 on dist-test-slave-1nl6"
server_key: "9fb37cd2dd2cdfcd31bfd7fdc1390c60"
server_key_iv: "0c6afef00044089e4ef1002829795926"
server_key_version: "encryptionkey@0"
I20260811 18:54:27.730877 29529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:27.753844 29529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:27.754678 29529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:27.755039 29529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:27.773382 29529 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:32895
I20260811 18:54:27.773401 29634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:32895 every 8 connection(s)
I20260811 18:54:27.774739 29529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:27.778354 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 29529
I20260811 18:54:27.778373 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:27.778577 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:27.779323 20079 external_mini_cluster.cc:1428] Setting key b59956f8f706f5e71b95fdd7eb13264a
I20260811 18:54:27.791602 29635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0: Bootstrap starting.
I20260811 18:54:27.793089 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:27.781297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50388 (local address 127.19.155.254:32895)
0811 18:54:27.782329 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:27.782339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:27.782389 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:54:27.784215 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:27.784236 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:27.784680 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:27.784998 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:27.785591 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.786803 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.788747 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.789415 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.789540 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.790807 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:27.790815 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:27.790827 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:27.791409 (+ 582us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:27.791485 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:27.791505 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:27.791593 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:27.791870 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:54:27.792208 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":404,"threads_started":1}
I20260811 18:54:27.794751 29635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:27.795930 29635 log.cc:824] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:27.796981 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:54:27.798655 29635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0: No bootstrap required, opened a new log
I20260811 18:54:27.806371 29635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } }
I20260811 18:54:27.806742 29635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:27.806851 29635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32964bdb2900479bb3cdc75863a5a9a0, State: Initialized, Role: FOLLOWER
I20260811 18:54:27.807404 29635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } }
I20260811 18:54:27.807631 29635 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:27.807778 29635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:27.807953 29635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:27.810139 29635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } }
I20260811 18:54:27.810755 29635 leader_election.cc:302] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32964bdb2900479bb3cdc75863a5a9a0; no voters:
I20260811 18:54:27.811353 29635 leader_election.cc:288] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:27.811529 29647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:27.812250 29647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [term 1 LEADER]: Becoming Leader. State: Replica: 32964bdb2900479bb3cdc75863a5a9a0, State: Running, Role: LEADER
I20260811 18:54:27.812793 29647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } }
I20260811 18:54:27.813434 29635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:27.815898 29651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32964bdb2900479bb3cdc75863a5a9a0. Latest consensus state: current_term: 1 leader_uuid: "32964bdb2900479bb3cdc75863a5a9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } } }
I20260811 18:54:27.816260 29651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:27.816855 29649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32964bdb2900479bb3cdc75863a5a9a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32964bdb2900479bb3cdc75863a5a9a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 32895 } } }
I20260811 18:54:27.817199 29649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:27.818500 29656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:27.823967 29656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:27.833874 29656 catalog_manager.cc:1347] Generated new cluster ID: f946c4ed9ee640a9ba0865580d245d61
I20260811 18:54:27.834069 29656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:27.842084 29656 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:27.843293 29656 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:27.849561 29656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32964bdb2900479bb3cdc75863a5a9a0: Generated new TSK 0
I20260811 18:54:27.850258 29656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:54:27.869292 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:27.861006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50392 (local address 127.19.155.254:32895)
0811 18:54:27.861159 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:27.861163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:27.861558 (+ 395us) server_negotiation.cc:407] Connection header received
0811 18:54:27.861731 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:27.861736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:27.861856 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:27.862024 (+ 168us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:54:27.862513 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.863641 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.864975 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.865645 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.865766 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.866283 (+ 517us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:54:27.868640 (+ 2357us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42897/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:54:27.868970 (+ 330us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42897/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 18:54:27.869427 29641 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42897/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 18:54:27.870955 29691 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:27.860870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:32895 (local address 127.0.0.1:50392)
0811 18:54:27.861439 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:27.861453 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:27.861565 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:27.862048 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:27.862051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:27.862060 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:54:27.862356 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:27.862364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.863784 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.863788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:27.864826 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:27.864836 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:27.865827 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:27.865832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:27.865966 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:27.865997 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:54:27.868857 (+ 2860us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42897/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:54:27.870505 (+ 1648us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.155.254:32895: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42897/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":1332,"thread_start_us":326,"threads_started":1}
I20260811 18:54:27.872010 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 29529
I20260811 18:54:27.873175 29628 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 18:54:27.881029 29692 webserver.cc:533] Webserver: sslize failed:
E20260811 18:54:27.881150 29692 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:54:27.961452 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 29529
2026-08-11T18:54:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (713 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T18:54:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:28Z Disabled control of system clock
I20260811 18:54:28.059249 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44107
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:35025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44107
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/testchainca.cert with env {}
W20260811 18:54:28.382781 29699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:28.383126 29699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:28.383301 29699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:28.390213 29699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:28.390300 29699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:28.390337 29699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:28.390414 29699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:28.390501 29699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:54:28.390604 29699 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:54:28.390683 29699 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 18:54:28.400136 29699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44107
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:28.401329 29699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:28.402549 29699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:28.414094 29709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:28.414058 29710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:28.414148 29712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:28.414986 29699 server_base.cc:1034] running on GCE node
I20260811 18:54:28.415648 29699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:28.416920 29699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:28.418133 29699 hybrid_clock.cc:648] HybridClock initialized: now 1786474468418094 us; error 37 us; skew 500 ppm
I20260811 18:54:28.418480 29699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:54:28.420666 29699 webserver.cc:460] Webserver started at http://127.19.155.254:44125/ using document root <none> and password file <none>
I20260811 18:54:28.421319 29699 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:28.421439 29699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:28.421761 29699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:28.424600 29699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "66c9c6263b3d465f926e8196ef3b8528"
format_stamp: "Formatted at 2026-08-11 18:54:28 on dist-test-slave-1nl6"
server_key: "6d2865e329d9e1bc8cac4308097bf4f9"
server_key_iv: "9ef4d01d9a77ea2ce3dce820fc9a8be6"
server_key_version: "encryptionkey@0"
I20260811 18:54:28.425411 29699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "66c9c6263b3d465f926e8196ef3b8528"
format_stamp: "Formatted at 2026-08-11 18:54:28 on dist-test-slave-1nl6"
server_key: "6d2865e329d9e1bc8cac4308097bf4f9"
server_key_iv: "9ef4d01d9a77ea2ce3dce820fc9a8be6"
server_key_version: "encryptionkey@0"
I20260811 18:54:28.430312 29699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 18:54:28.433528 29720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:28.434780 29699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 18:54:28.434993 29699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "66c9c6263b3d465f926e8196ef3b8528"
format_stamp: "Formatted at 2026-08-11 18:54:28 on dist-test-slave-1nl6"
server_key: "6d2865e329d9e1bc8cac4308097bf4f9"
server_key_iv: "9ef4d01d9a77ea2ce3dce820fc9a8be6"
server_key_version: "encryptionkey@0"
I20260811 18:54:28.435200 29699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:28.454331 29699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:28.455133 29699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:28.455399 29699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:28.473516 29699 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44107
I20260811 18:54:28.473548 29806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44107 every 8 connection(s)
I20260811 18:54:28.474822 29699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:28.477231 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 29699
I20260811 18:54:28.477443 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:28.478121 20079 external_mini_cluster.cc:1428] Setting key 47024fc903f3cb96a68669222351ded3
I20260811 18:54:28.478691 29809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:28.493577 29816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:28.480042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54678 (local address 127.19.155.254:44107)
0811 18:54:28.481087 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:28.481102 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:28.481168 (+ 66us) server_negotiation.cc:407] Connection header received
0811 18:54:28.483588 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:28.483618 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:28.484205 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:28.484667 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:28.485186 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.487152 (+ 1966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.488352 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.489370 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.489562 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:28.490649 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:28.490661 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:28.490697 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:54:28.491465 (+ 768us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:28.491559 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:54:28.491586 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:28.491715 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:28.491990 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 18:54:28.492321 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":315,"threads_started":1}
I20260811 18:54:28.493985 29809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528: Bootstrap starting.
I20260811 18:54:28.497257 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:54:28.497509 29809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:28.498477 29809 log.cc:824] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:28.501255 29809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528: No bootstrap required, opened a new log
I20260811 18:54:28.508064 29809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } }
I20260811 18:54:28.508502 29809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:28.508605 29809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66c9c6263b3d465f926e8196ef3b8528, State: Initialized, Role: FOLLOWER
I20260811 18:54:28.509196 29809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } }
I20260811 18:54:28.509438 29809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:28.509586 29809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:28.509756 29809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:28.511834 29809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } }
I20260811 18:54:28.512339 29809 leader_election.cc:302] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66c9c6263b3d465f926e8196ef3b8528; no voters:
I20260811 18:54:28.512934 29809 leader_election.cc:288] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:28.513139 29825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:28.514261 29825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [term 1 LEADER]: Becoming Leader. State: Replica: 66c9c6263b3d465f926e8196ef3b8528, State: Running, Role: LEADER
I20260811 18:54:28.514762 29825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } }
I20260811 18:54:28.515138 29809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:28.517766 29826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66c9c6263b3d465f926e8196ef3b8528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } } }
I20260811 18:54:28.517738 29827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66c9c6263b3d465f926e8196ef3b8528. Latest consensus state: current_term: 1 leader_uuid: "66c9c6263b3d465f926e8196ef3b8528" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66c9c6263b3d465f926e8196ef3b8528" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44107 } } }
I20260811 18:54:28.518141 29826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:28.518227 29827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:28.520773 29834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:28.525615 29834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:28.533914 29834 catalog_manager.cc:1347] Generated new cluster ID: 6bff5d313ded4661b050da3a3ac057f6
I20260811 18:54:28.534015 29834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:28.541364 29834 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:28.543136 29834 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:28.550670 29834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66c9c6263b3d465f926e8196ef3b8528: Generated new TSK 0
I20260811 18:54:28.551529 29834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:54:29.495929 29816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:28.565564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54682 (local address 127.19.155.254:44107)
0811 18:54:28.565729 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:28.565734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:28.566145 (+ 411us) server_negotiation.cc:407] Connection header received
0811 18:54:28.566323 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:28.566330 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:28.566416 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:28.566589 (+ 173us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:54:28.567045 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.568151 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.569441 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.570145 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.570276 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:28.570734 (+ 458us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:54:29.495401 (+924667us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:54:29.495708 (+ 307us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54682: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 18:54:29.496028 29816 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54682: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 18:54:29.496357 29869 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:28.565438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44107 (local address 127.0.0.1:54682)
0811 18:54:28.566041 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:28.566056 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:28.566170 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:28.566606 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:28.566609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:28.566618 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:54:28.566856 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:28.566863 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.568297 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.568301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:28.569301 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:28.569311 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:28.570307 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:28.570312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:28.570443 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:28.570474 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:54:29.495679 (+925205us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:54:29.495933 (+ 254us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.155.254:44107: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":332,"threads_started":1}
I20260811 18:54:29.497573 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 29699
I20260811 18:54:29.498745 29801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:29.598887 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 29699
2026-08-11T18:54:29Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1619 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (414 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (425 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:30 dist-test-slave-1nl6 krb5kdc[29892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:30 dist-test-slave-1nl6 krb5kdc[29892](info): set up 2 sockets
Aug 11 18:54:30 dist-test-slave-1nl6 krb5kdc[29892](info): commencing operation
krb5kdc: starting...
W20260811 18:54:31.748257 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:31 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:31.980265 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38479
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:32.330690 29912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:32.331038 29912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:32.331215 29912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:32.338783 29912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:32.338907 29912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:32.339010 29912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:32.339092 29912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:32.339156 29912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:32.348675 29912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:32.349998 29912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:32.351325 29912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:32.363128 29919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:32.363166 29922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:32.363231 29920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:32.363984 29912 server_base.cc:1034] running on GCE node
I20260811 18:54:32.364771 29912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:32.366007 29912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:32.367242 29912 hybrid_clock.cc:648] HybridClock initialized: now 1786474472367195 us; error 58 us; skew 500 ppm
I20260811 18:54:32.367595 29912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:32 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474472, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:32.370745 29912 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:32.372308 29912 webserver.cc:460] Webserver started at http://127.19.155.254:40517/ using document root <none> and password file <none>
I20260811 18:54:32.372974 29912 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:32.373126 29912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:32.373461 29912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:32.376544 29912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "995d7082015648688a2c13777a286c1d"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "05ed8730654e16275b6e58b82b5481c7"
server_key_iv: "c2b1f2cb44af529ba69d3262f4699938"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.377367 29912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "995d7082015648688a2c13777a286c1d"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "05ed8730654e16275b6e58b82b5481c7"
server_key_iv: "c2b1f2cb44af529ba69d3262f4699938"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.382447 29912 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:32.385913 29933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:32.387217 29912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:32.387411 29912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "995d7082015648688a2c13777a286c1d"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "05ed8730654e16275b6e58b82b5481c7"
server_key_iv: "c2b1f2cb44af529ba69d3262f4699938"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.387606 29912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:32.408082 29912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:32.412583 29912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:32.412891 29912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:32.431608 29912 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:38479
I20260811 18:54:32.431646 30039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:38479 every 8 connection(s)
I20260811 18:54:32.433017 29912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:32.435297 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 29912
I20260811 18:54:32.435539 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:32.436379 20079 external_mini_cluster.cc:1428] Setting key 2fc7ad1a4f643c0d71447292017eabed
I20260811 18:54:32.437563 30040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:32.449425 30040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d: Bootstrap starting.
Aug 11 18:54:32 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:32.453013 30040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:32.454089 30040 log.cc:824] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:32.456895 30040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d: No bootstrap required, opened a new log
I20260811 18:54:32.458153 30043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:32.438425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55102 (local address 127.19.155.254:38479)
0811 18:54:32.439144 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:32.439155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:32.439194 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:54:32.440758 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:32.440779 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:32.441147 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:32.441569 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:32.443155 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:32.444434 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:32.445656 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:32.446375 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:32.446593 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:32.450799 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:32.450808 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:32.450821 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:32.450859 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:32.453998 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:32.454743 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:32.454750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:32.454758 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:32.454985 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:32.455407 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:32.455412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:32.455423 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:32.455922 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:32.456246 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:32.456712 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 18:54:32.457184 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":294,"threads_started":1}
I20260811 18:54:32.464448 30040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } }
I20260811 18:54:32.464813 30040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:32.464922 30040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995d7082015648688a2c13777a286c1d, State: Initialized, Role: FOLLOWER
I20260811 18:54:32.465466 30040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } }
I20260811 18:54:32.465709 30040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:32.465857 30040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:32.466030 30040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:32.468365 30040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } }
I20260811 18:54:32.468852 30040 leader_election.cc:302] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 995d7082015648688a2c13777a286c1d; no voters:
I20260811 18:54:32.469419 30040 leader_election.cc:288] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:32.469551 30047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:32.470286 30047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [term 1 LEADER]: Becoming Leader. State: Replica: 995d7082015648688a2c13777a286c1d, State: Running, Role: LEADER
I20260811 18:54:32.470830 30047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } }
I20260811 18:54:32.471630 30040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:32.473694 30049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "995d7082015648688a2c13777a286c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } } }
I20260811 18:54:32.474078 30049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:32.474663 30052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 995d7082015648688a2c13777a286c1d. Latest consensus state: current_term: 1 leader_uuid: "995d7082015648688a2c13777a286c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995d7082015648688a2c13777a286c1d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38479 } } }
I20260811 18:54:32.475033 30052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:32.475746 30057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:32.481491 30057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:32.490635 30057 catalog_manager.cc:1347] Generated new cluster ID: 1ee5099d819f417f994169321f3d700e
I20260811 18:54:32.490757 30057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:32.502483 30057 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:32.503813 30057 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:32.509805 30057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 995d7082015648688a2c13777a286c1d: Generated new TSK 0
I20260811 18:54:32.510565 30057 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:32.579146 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:32.931406 30084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:32.931686 30084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:32.931782 30084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:32.938810 30084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:32.938927 30084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:32.939095 30084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:32.948503 30084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:32.949738 30084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:32.951089 30084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:32.964323 30093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:32.964550 30095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:32.964932 30091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:32.965201 30084 server_base.cc:1034] running on GCE node
I20260811 18:54:32.965783 30084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:32.966660 30084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:32.967897 30084 hybrid_clock.cc:648] HybridClock initialized: now 1786474472967835 us; error 72 us; skew 500 ppm
I20260811 18:54:32.968240 30084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:32 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474472, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:32.971328 30084 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:32.972936 30084 webserver.cc:460] Webserver started at http://127.19.155.193:46237/ using document root <none> and password file <none>
I20260811 18:54:32.973604 30084 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:32.973744 30084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:32.974077 30084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:32.977053 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "c1b4ba4d882741dfae9e89d14d8a7a11"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "6d51d35bad90c94d1dc6061c589eb551"
server_key_iv: "50836eeeaa7dd227f53edb541e47cea0"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.977870 30084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "c1b4ba4d882741dfae9e89d14d8a7a11"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "6d51d35bad90c94d1dc6061c589eb551"
server_key_iv: "50836eeeaa7dd227f53edb541e47cea0"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.982774 30084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260811 18:54:32.986373 30105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:32.987614 30084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:32.987802 30084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "c1b4ba4d882741dfae9e89d14d8a7a11"
format_stamp: "Formatted at 2026-08-11 18:54:32 on dist-test-slave-1nl6"
server_key: "6d51d35bad90c94d1dc6061c589eb551"
server_key_iv: "50836eeeaa7dd227f53edb541e47cea0"
server_key_version: "encryptionkey@0"
I20260811 18:54:32.988003 30084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:33.010223 30084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:33.014349 30084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:33.014657 30084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:33.015748 30084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:33.017059 30084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:33.017168 30084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.017359 30084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:33.017433 30084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.050807 30084 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35553
I20260811 18:54:33.050865 30281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35553 every 8 connection(s)
I20260811 18:54:33.052167 30084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:33.056180 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 30084
I20260811 18:54:33.056387 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:33.057051 20079 external_mini_cluster.cc:1428] Setting key 477bf97187bae36737ec2c3672b49f7b
Aug 11 18:54:33 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474472, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:33.073136 30284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:33.054790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:59905 (local address 127.19.155.254:38479)
0811 18:54:33.055277 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:33.055282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:33.056194 (+ 912us) server_negotiation.cc:407] Connection header received
0811 18:54:33.058146 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:33.058152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:33.058240 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:33.058358 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:33.059885 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.060601 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.062112 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.062516 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.062651 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:33.066215 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:33.066220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:33.066223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:33.066261 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:33.069583 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.070550 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.070554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.070556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.070678 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.071225 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.071229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.071231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.071483 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:33.071643 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:33.072590 (+ 947us) server_negotiation.cc:299] Negotiation successful
0811 18:54:33.072836 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":279,"threads_started":1}
I20260811 18:54:33.074522 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:33.055295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38479 (local address 127.19.155.193:59905)
0811 18:54:33.056019 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:33.056066 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:33.057871 (+ 1805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:33.058595 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:33.058603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:33.059114 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:33.059709 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:33.059726 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.060756 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.060766 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:33.061958 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:33.061970 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.062754 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.062763 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:33.063093 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:33.063820 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:33.063847 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:33.065999 (+ 2152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:33.069729 (+ 3730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:33.069741 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:33.069768 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:33.070406 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:33.070798 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:33.070805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:33.070812 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:33.071078 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:33.071620 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:33.071630 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:33.072118 (+ 488us) client_negotiation.cc:769] Sending connection context
0811 18:54:33.072504 (+ 386us) client_negotiation.cc:240] Negotiation successful
0811 18:54:33.073098 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":313,"threads_started":1}
I20260811 18:54:33.076117 30282 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38479
I20260811 18:54:33.076442 30282 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:33.077139 30282 heartbeater.cc:511] Master 127.19.155.254:38479 requested a full tablet report, sending...
I20260811 18:54:33.079437 29964 ts_manager.cc:194] Registered new tserver with Master: c1b4ba4d882741dfae9e89d14d8a7a11 (127.19.155.193:35553)
I20260811 18:54:33.080853 29964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:59905
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:33.113510 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:33.441768 30291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:33.442031 30291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:33.442183 30291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:33.449616 30291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:33.449726 30291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:33.449935 30291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:33.460301 30291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:33.461561 30291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:33.462883 30291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:33.476157 30296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.476218 30299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.476254 30297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:33.477129 30291 server_base.cc:1034] running on GCE node
I20260811 18:54:33.477818 30291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:33.478844 30291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:33.480093 30291 hybrid_clock.cc:648] HybridClock initialized: now 1786474473480039 us; error 47 us; skew 500 ppm
I20260811 18:54:33.480419 30291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:33 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:33.483760 30291 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:33.485339 30291 webserver.cc:460] Webserver started at http://127.19.155.194:35319/ using document root <none> and password file <none>
I20260811 18:54:33.485975 30291 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:33.486079 30291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:33.486398 30291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:33.489522 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "800d07ef54a648fcbf15285f562d2cba"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "c88c514c1e3ea5894df9156e13896032"
server_key_iv: "f2ae8c7fba0edf81ed0f9710d5e49026"
server_key_version: "encryptionkey@0"
I20260811 18:54:33.490329 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "800d07ef54a648fcbf15285f562d2cba"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "c88c514c1e3ea5894df9156e13896032"
server_key_iv: "f2ae8c7fba0edf81ed0f9710d5e49026"
server_key_version: "encryptionkey@0"
I20260811 18:54:33.495921 30291 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 18:54:33.499369 30313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.500638 30291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 18:54:33.500811 30291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "800d07ef54a648fcbf15285f562d2cba"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "c88c514c1e3ea5894df9156e13896032"
server_key_iv: "f2ae8c7fba0edf81ed0f9710d5e49026"
server_key_version: "encryptionkey@0"
I20260811 18:54:33.501032 30291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:33.522794 30291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:33.527410 30291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:33.527715 30291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:33.528698 30291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:33.530017 30291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:33.530090 30291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.530277 30291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:33.530329 30291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.563668 30291 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:40655
I20260811 18:54:33.563750 30491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:40655 every 8 connection(s)
I20260811 18:54:33.565003 30291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:33.565428 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 30291
I20260811 18:54:33.565608 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:33.566253 20079 external_mini_cluster.cc:1428] Setting key e2a67b6634148fa367d33f4439a34a18
Aug 11 18:54:33 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:33.588371 30284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:33.567814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:38135 (local address 127.19.155.254:38479)
0811 18:54:33.567993 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:33.567998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:33.569583 (+ 1585us) server_negotiation.cc:407] Connection header received
0811 18:54:33.572489 (+ 2906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:33.572492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:33.572556 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:33.572642 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:33.574777 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.575626 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.578120 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.578584 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.578788 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:33.582540 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:33.582545 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:33.582548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:33.582580 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:33.585242 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.585985 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.585992 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.585995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.586130 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.586568 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.586573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.586577 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.586866 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:33.587097 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:33.587772 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 18:54:33.587998 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:54:33.589401 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:33.568505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38479 (local address 127.19.155.194:38135)
0811 18:54:33.569388 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:33.569452 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:33.572210 (+ 2758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:33.572910 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:33.572923 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:33.573740 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:33.574580 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:33.574608 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.575808 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.575816 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:33.577947 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:33.577966 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.578917 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.578927 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:33.579186 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:33.579890 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:33.579913 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:33.582311 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:33.585395 (+ 3084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:33.585405 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:33.585421 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:33.585856 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:33.586249 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:33.586254 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:33.586258 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:33.586450 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:33.587067 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:33.587075 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:33.587425 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 18:54:33.587697 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 18:54:33.588247 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":322,"threads_started":1}
I20260811 18:54:33.591014 30492 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38479
I20260811 18:54:33.591351 30492 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:33.592240 30492 heartbeater.cc:511] Master 127.19.155.254:38479 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
I20260811 18:54:33.593885 29964 ts_manager.cc:194] Registered new tserver with Master: 800d07ef54a648fcbf15285f562d2cba (127.19.155.194:40655)
I20260811 18:54:33.594731 29964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:38135
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:33.623275 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:33.955788 30497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:33.956063 30497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:33.956164 30497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:33.963101 30497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:33.963207 30497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:33.963327 30497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:33.972815 30497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:33.974014 30497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:33.975466 30497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:33.989091 30502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.989114 30504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.989300 30507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:33.990099 30497 server_base.cc:1034] running on GCE node
I20260811 18:54:33.990718 30497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:33.991763 30497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:33.993007 30497 hybrid_clock.cc:648] HybridClock initialized: now 1786474473992973 us; error 42 us; skew 500 ppm
I20260811 18:54:33.993305 30497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:33 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:33.996640 30497 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:33.998029 30497 webserver.cc:460] Webserver started at http://127.19.155.195:43185/ using document root <none> and password file <none>
I20260811 18:54:33.998652 30497 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:33.998790 30497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:33.999152 30497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:34.002038 30497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "8a4f2eac0793471cb4abaf5c6b689885"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "e3da9eee0c84e09b57f1a1df9734c8b3"
server_key_iv: "d4bfee8a9834c36fcc21c2fb7c0fa1f9"
server_key_version: "encryptionkey@0"
I20260811 18:54:34.002821 30497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "8a4f2eac0793471cb4abaf5c6b689885"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "e3da9eee0c84e09b57f1a1df9734c8b3"
server_key_iv: "d4bfee8a9834c36fcc21c2fb7c0fa1f9"
server_key_version: "encryptionkey@0"
I20260811 18:54:34.008119 30497 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 18:54:34.011603 30519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:34.013007 30497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:54:34.013209 30497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "8a4f2eac0793471cb4abaf5c6b689885"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-1nl6"
server_key: "e3da9eee0c84e09b57f1a1df9734c8b3"
server_key_iv: "d4bfee8a9834c36fcc21c2fb7c0fa1f9"
server_key_version: "encryptionkey@0"
I20260811 18:54:34.013433 30497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:34.044150 30497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:34.048775 30497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:34.049084 30497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:34.050174 30497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:34.051947 30497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:34.052040 30497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:34.052170 30497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:34.052244 30497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:34.083711 30282 heartbeater.cc:503] Master 127.19.155.254:38479 was elected leader, sending a full tablet report...
I20260811 18:54:34.088449 30497 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:36931
I20260811 18:54:34.088505 30683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:36931 every 8 connection(s)
I20260811 18:54:34.089778 30497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:34.097451 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 30497
I20260811 18:54:34.097644 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:34.098101 20079 external_mini_cluster.cc:1428] Setting key c9f0b4c426aecab17ddb8bf5bd1ee299
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:34.112169 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.092712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:38331 (local address 127.19.155.254:38479)
0811 18:54:34.093196 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.093201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.094316 (+ 1115us) server_negotiation.cc:407] Connection header received
0811 18:54:34.097142 (+ 2826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.097148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.097241 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.097369 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.099273 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.100460 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.102132 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.102550 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.102682 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.106335 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.106342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.106346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.106387 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.108997 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.109720 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.109726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.109729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.109861 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.110324 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.110328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.110332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.110601 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.110764 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.111517 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.111743 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":262,"threads_started":1}
I20260811 18:54:34.113310 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.093186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38479 (local address 127.19.155.195:38331)
0811 18:54:34.094132 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:34.094193 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:34.096840 (+ 2647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:34.097639 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:34.097650 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:34.098262 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:34.099085 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:34.099112 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.100617 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.100623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:34.101987 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:34.102000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.102806 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.102815 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:34.103110 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.103723 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:34.103745 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:34.106129 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:34.109150 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:34.109158 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:34.109174 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:34.109594 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:34.109976 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:34.109981 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:34.109985 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:34.110196 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:34.110738 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:34.110746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:34.111157 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 18:54:34.111421 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 18:54:34.111963 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":379,"threads_started":1}
I20260811 18:54:34.114602 30684 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38479
I20260811 18:54:34.114972 30684 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:34.115728 30684 heartbeater.cc:511] Master 127.19.155.254:38479 requested a full tablet report, sending...
I20260811 18:54:34.117192 29964 ts_manager.cc:194] Registered new tserver with Master: 8a4f2eac0793471cb4abaf5c6b689885 (127.19.155.195:36931)
I20260811 18:54:34.118028 29964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:38331
I20260811 18:54:34.126583 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/test-admin.keytab.
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.161562 20079 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 18:54:34.166885 30695 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:34.164445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45554 (local address 127.19.155.193:35553)
0811 18:54:34.165064 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.165071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.165099 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:54:34.165200 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.165208 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.165441 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.165588 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.166483 (+ 895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45554: BlockingRecv error: recv got EOF from 127.0.0.1:45554 (error 108)
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":314,"threads_started":1}
W20260811 18:54:34.167647 20079 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc)
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.169245 20079 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.170573 20079 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:34.186371 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.172226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45558 (local address 127.19.155.193:35553)
0811 18:54:34.172406 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.172415 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.172777 (+ 362us) server_negotiation.cc:407] Connection header received
0811 18:54:34.172972 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.172981 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.173038 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.173143 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.174139 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.175206 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.176415 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.176981 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.177131 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.180669 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.180680 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.180695 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.180727 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.183536 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.184245 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.184253 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.184256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.184384 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.184782 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.184788 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.184791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.185163 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.185471 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.185829 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.186097 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 18:54:34.192341 30695 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:34.190339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45570 (local address 127.19.155.193:35553)
0811 18:54:34.190555 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.190562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.190821 (+ 259us) server_negotiation.cc:407] Connection header received
0811 18:54:34.191076 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.191080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.191159 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.191250 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.192089 (+ 839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45570: BlockingRecv error: recv got EOF from 127.0.0.1:45570 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 18:54:34.192504 20079 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.194065 20079 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.195403 20079 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:34.209084 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.196564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45576 (local address 127.19.155.193:35553)
0811 18:54:34.196777 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.196785 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.197057 (+ 272us) server_negotiation.cc:407] Connection header received
0811 18:54:34.197229 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.197234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.197296 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.197395 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.198311 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.199027 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.200208 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.200617 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.200764 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.204126 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.204130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.204134 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.204162 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.207000 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.207641 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.207645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.207647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.207763 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.208079 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.208082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.208084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.208321 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.208511 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.208712 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.208854 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 18:54:34.213274 30695 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:34.211575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45578 (local address 127.19.155.193:35553)
0811 18:54:34.211766 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.211772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.211998 (+ 226us) server_negotiation.cc:407] Connection header received
0811 18:54:34.212204 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.212208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.212272 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.212372 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.213047 (+ 675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45578: BlockingRecv error: recv got EOF from 127.0.0.1:45578 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 18:54:34.213464 20079 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474422014372-20079-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.214977 20079 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.216163 20079 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:34.229563 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.217313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45584 (local address 127.19.155.193:35553)
0811 18:54:34.217447 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.217467 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.217837 (+ 370us) server_negotiation.cc:407] Connection header received
0811 18:54:34.217964 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.217968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.218050 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.218153 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.219183 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.219863 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.220989 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.221409 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.221518 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.224815 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.224820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.224823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.224851 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.227510 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.228108 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.228111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.228113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.228251 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.228547 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.228550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.228552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.228794 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.228996 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.229186 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.229333 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 18:54:34.230966 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 30084
I20260811 18:54:34.241779 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.231662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.19.155.193:35553)
0811 18:54:34.231814 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.231817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.232061 (+ 244us) server_negotiation.cc:407] Connection header received
0811 18:54:34.232270 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.232274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.232325 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.232403 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.233278 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.233897 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.235133 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.235538 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.235626 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.237396 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.237400 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.237403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.237430 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.239750 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.240283 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.240287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.240289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.240412 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.240719 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.240722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.240723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.240927 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.241129 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.241365 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.241532 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:54:34.242373 30275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:34.324398 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 30084
I20260811 18:54:34.349607 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 30291
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:34.365006 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.350512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.19.155.194:40655)
0811 18:54:34.351109 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.351117 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.351143 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:54:34.351212 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.351219 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.351446 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.351574 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.352514 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.353553 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.354855 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.355628 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.355731 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.359499 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.359511 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.359526 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.359568 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.362384 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.363186 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.363193 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.363196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.363339 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.363670 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.363673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.363675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.364020 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.364269 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.364511 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.364713 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":292,"threads_started":1}
I20260811 18:54:34.366370 30484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:34.447021 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 30291
I20260811 18:54:34.470098 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 30497
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[29892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:34.486025 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:34.471144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38876 (local address 127.19.155.195:36931)
0811 18:54:34.471875 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:34.471891 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:34.471935 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:54:34.472002 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:34.472008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:34.472236 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:34.472439 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:34.473373 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.474412 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.475652 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:34.476218 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:34.476319 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:34.480392 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:34.480404 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:34.480418 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:34.480449 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:34.483431 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.484173 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.484179 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.484181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.484301 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:34.484631 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:34.484634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:34.484636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:34.485004 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:34.485259 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:34.485448 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:54:34.485725 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":341,"threads_started":1}
I20260811 18:54:34.487414 30674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:34.568941 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 30497
I20260811 18:54:34.594123 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 29912
I20260811 18:54:34.595376 30030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:34.697821 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 29912
2026-08-11T18:54:34Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4262 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[30721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[30721](info): set up 2 sockets
Aug 11 18:54:34 dist-test-slave-1nl6 krb5kdc[30721](info): commencing operation
krb5kdc: starting...
W20260811 18:54:36.014827 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:36 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab.
Entry for principal oryx/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab.
I20260811 18:54:36.255497 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46301
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab
--principal=oryx/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:36.579296 30744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:36.579628 30744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:36.579800 30744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:36.587538 30744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:36.587668 30744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:36.587751 30744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:36.587836 30744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:36.587903 30744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:36.597407 30744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab
--principal=oryx/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:36.598742 30744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:36.600075 30744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:36.611778 30752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:36.611990 30757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:36.611810 30755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:36.612849 30744 server_base.cc:1034] running on GCE node
I20260811 18:54:36.613600 30744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:36.615057 30744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:36.616338 30744 hybrid_clock.cc:648] HybridClock initialized: now 1786474476616289 us; error 50 us; skew 500 ppm
I20260811 18:54:36.616693 30744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:36 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:36.623271 30744 init.cc:377] Logged in from keytab as oryx/127.19.155.254@KRBTEST.COM (short username oryx)
I20260811 18:54:36.624720 30744 webserver.cc:460] Webserver started at http://127.19.155.254:46727/ using document root <none> and password file <none>
I20260811 18:54:36.625420 30744 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:36.625578 30744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:36.625888 30744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:36.628985 30744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "1dfb2305c362492c85f5a95b5a32fc1b"
format_stamp: "Formatted at 2026-08-11 18:54:36 on dist-test-slave-1nl6"
server_key: "2df73cf256bd8a0078dd1ba4fdf09284"
server_key_iv: "6decf6110dac1beab826408b08ad8eeb"
server_key_version: "encryptionkey@0"
I20260811 18:54:36.629798 30744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "1dfb2305c362492c85f5a95b5a32fc1b"
format_stamp: "Formatted at 2026-08-11 18:54:36 on dist-test-slave-1nl6"
server_key: "2df73cf256bd8a0078dd1ba4fdf09284"
server_key_iv: "6decf6110dac1beab826408b08ad8eeb"
server_key_version: "encryptionkey@0"
I20260811 18:54:36.634981 30744 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:54:36.638325 30765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:36.639657 30744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:54:36.639847 30744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "1dfb2305c362492c85f5a95b5a32fc1b"
format_stamp: "Formatted at 2026-08-11 18:54:36 on dist-test-slave-1nl6"
server_key: "2df73cf256bd8a0078dd1ba4fdf09284"
server_key_iv: "6decf6110dac1beab826408b08ad8eeb"
server_key_version: "encryptionkey@0"
I20260811 18:54:36.640040 30744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:36.664693 30744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:36.668603 30744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:36.668908 30744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:36.687353 30744 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46301
I20260811 18:54:36.687397 30859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46301 every 8 connection(s)
I20260811 18:54:36.688702 30744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:36.692394 30860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:36.695832 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 30744
I20260811 18:54:36.696022 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:36.696704 20079 external_mini_cluster.cc:1428] Setting key 07dd16d87c97a02a52f7318ed7dab8ae
I20260811 18:54:36.705333 30860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Bootstrap starting.
I20260811 18:54:36.709231 30860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:36.710599 30860 log.cc:824] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:54:36 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:36.713776 30860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: No bootstrap required, opened a new log
I20260811 18:54:36.720273 30865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:36.698775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60828 (local address 127.19.155.254:46301)
0811 18:54:36.699627 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:36.699639 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:36.699679 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:54:36.701158 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:36.701179 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:36.701555 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:36.701868 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:36.703744 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:36.705052 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:36.706850 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:36.707582 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:36.707710 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:36.712821 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:36.712829 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:36.712843 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:36.712879 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:36.716185 (+ 3306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:36.716974 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:36.716979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:36.716985 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:36.717138 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:36.717590 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:36.717594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:36.717595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:36.718062 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:36.718305 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:36.718761 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 18:54:36.719238 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":379,"threads_started":1}
I20260811 18:54:36.722487 30860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } }
I20260811 18:54:36.722862 30860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:36.723037 30860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dfb2305c362492c85f5a95b5a32fc1b, State: Initialized, Role: FOLLOWER
I20260811 18:54:36.723601 30860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } }
I20260811 18:54:36.723807 30860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:36.723906 30860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:36.724031 30860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:36.726361 30860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } }
I20260811 18:54:36.726874 30860 leader_election.cc:302] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dfb2305c362492c85f5a95b5a32fc1b; no voters:
I20260811 18:54:36.727496 30860 leader_election.cc:288] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:36.727626 30868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:36.728363 30868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 LEADER]: Becoming Leader. State: Replica: 1dfb2305c362492c85f5a95b5a32fc1b, State: Running, Role: LEADER
I20260811 18:54:36.728922 30868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } }
I20260811 18:54:36.729611 30860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:36.731817 30869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } }
I20260811 18:54:36.732245 30869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:36.735764 30871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dfb2305c362492c85f5a95b5a32fc1b. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } }
I20260811 18:54:36.736137 30871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
W20260811 18:54:36.739398 30892 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:54:36.739504 30892 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:54:36.739640 30882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:36.741755 30882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:36.750084 30882 catalog_manager.cc:1347] Generated new cluster ID: e52cc51de3d045e8ba6121d338183009
I20260811 18:54:36.750185 30882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:36.769170 30882 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:36.770924 30882 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:36.777835 30882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Generated new TSK 0
I20260811 18:54:36.778759 30882 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
I20260811 18:54:36.838315 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:37.174228 30899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:37.174530 30899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:37.174697 30899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:37.181733 30899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:37.181893 30899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:37.182085 30899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:37.191623 30899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:37.192920 30899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:37.194243 30899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:37.207527 30905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:37.207564 30906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:37.207727 30908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:37.208472 30899 server_base.cc:1034] running on GCE node
I20260811 18:54:37.209005 30899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:37.209841 30899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:37.211118 30899 hybrid_clock.cc:648] HybridClock initialized: now 1786474477211078 us; error 58 us; skew 500 ppm
I20260811 18:54:37.211445 30899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:37 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474477, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:37.214730 30899 init.cc:377] Logged in from keytab as oryx/127.19.155.193@KRBTEST.COM (short username oryx)
I20260811 18:54:37.216077 30899 webserver.cc:460] Webserver started at http://127.19.155.193:42833/ using document root <none> and password file <none>
I20260811 18:54:37.216712 30899 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:37.216815 30899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:37.217058 30899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:37.219918 30899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "df927cef084e47349faca1a5721b0db4"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "adb67aaead5def84e47c1ea5845f131f"
server_key_iv: "924fa3012674e8e7e361617d8cb6d467"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.220654 30899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "df927cef084e47349faca1a5721b0db4"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "adb67aaead5def84e47c1ea5845f131f"
server_key_iv: "924fa3012674e8e7e361617d8cb6d467"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.225653 30899 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:54:37.228904 30920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.230193 30899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:37.230333 30899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "df927cef084e47349faca1a5721b0db4"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "adb67aaead5def84e47c1ea5845f131f"
server_key_iv: "924fa3012674e8e7e361617d8cb6d467"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.230521 30899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:37.249100 30899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:37.252904 30899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:37.253203 30899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:37.254114 30899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:37.255453 30899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:37.255540 30899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.255718 30899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:37.255800 30899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.289208 30899 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36435
I20260811 18:54:37.289247 31092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36435 every 8 connection(s)
I20260811 18:54:37.290504 30899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:37.292001 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 30899
I20260811 18:54:37.292241 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:37.292905 20079 external_mini_cluster.cc:1428] Setting key 879c50848777c5aece56348fae753935
Aug 11 18:54:37 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474477, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:37.313805 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:37.293214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:47041 (local address 127.19.155.254:46301)
0811 18:54:37.293950 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:37.293957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:37.294748 (+ 791us) server_negotiation.cc:407] Connection header received
0811 18:54:37.297529 (+ 2781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:37.297533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:37.297594 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:37.297683 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:37.299884 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.300567 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.303079 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.303477 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.303569 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:37.308102 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:37.308107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:37.308110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:37.308141 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:37.310663 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:37.311464 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:37.311469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:37.311472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:37.311595 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:37.312015 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:37.312020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:37.312023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:37.312321 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:37.312479 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:37.313191 (+ 712us) server_negotiation.cc:299] Negotiation successful
0811 18:54:37.313416 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":517,"threads_started":1}
I20260811 18:54:37.314718 31097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:37.293826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:47041)
0811 18:54:37.294600 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:37.294637 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:37.297216 (+ 2579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:37.297982 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:37.297995 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:37.298805 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:37.299713 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:37.299741 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.300742 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.300750 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:37.302934 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:37.302953 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.303727 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.303736 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:37.304066 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:37.304812 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:37.304851 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:37.307845 (+ 2994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:37.310838 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:37.310847 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:37.310862 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:37.311333 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:37.311708 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:37.311713 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:37.311717 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:37.311894 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:37.312455 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:37.312463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:37.312791 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 18:54:37.313166 (+ 375us) client_negotiation.cc:240] Negotiation successful
0811 18:54:37.313681 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":338,"threads_started":1}
I20260811 18:54:37.316463 31093 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:37.316766 31093 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:37.317519 31093 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:54:37.319698 30800 ts_manager.cc:194] Registered new tserver with Master: df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435)
I20260811 18:54:37.321277 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:47041
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
I20260811 18:54:37.350008 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:37.671108 31104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:37.671394 31104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:37.671553 31104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:37.678686 31104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:37.678798 31104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:37.679026 31104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:37.689105 31104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:37.690315 31104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:37.691642 31104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:37.704532 31115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:37.704569 31118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:37.704823 31121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:37.705430 31104 server_base.cc:1034] running on GCE node
I20260811 18:54:37.706064 31104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:37.707056 31104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:37.708264 31104 hybrid_clock.cc:648] HybridClock initialized: now 1786474477708212 us; error 35 us; skew 500 ppm
I20260811 18:54:37.708601 31104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:37 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474477, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:37.711905 31104 init.cc:377] Logged in from keytab as oryx/127.19.155.194@KRBTEST.COM (short username oryx)
I20260811 18:54:37.713305 31104 webserver.cc:460] Webserver started at http://127.19.155.194:34357/ using document root <none> and password file <none>
I20260811 18:54:37.713979 31104 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:37.714134 31104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:37.714412 31104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:37.717285 31104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "82a83bf9841a42e2beb310f5fde614d0"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "e5d8e4ef73b266fa0b4a75df8808b661"
server_key_iv: "ce7e8b691240c3819663b2a3dcc846a7"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.717988 31104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "82a83bf9841a42e2beb310f5fde614d0"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "e5d8e4ef73b266fa0b4a75df8808b661"
server_key_iv: "ce7e8b691240c3819663b2a3dcc846a7"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.722888 31104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:54:37.726167 31132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.727509 31104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:37.727685 31104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "82a83bf9841a42e2beb310f5fde614d0"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "e5d8e4ef73b266fa0b4a75df8808b661"
server_key_iv: "ce7e8b691240c3819663b2a3dcc846a7"
server_key_version: "encryptionkey@0"
I20260811 18:54:37.727875 31104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:37.753237 31104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:37.757560 31104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:37.757859 31104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:37.758818 31104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:37.760155 31104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:37.760226 31104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.760397 31104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:37.760449 31104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:37.793501 31104 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:42735
I20260811 18:54:37.793589 31317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:42735 every 8 connection(s)
I20260811 18:54:37.794762 31104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:37.801735 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 31104
I20260811 18:54:37.801949 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:37.802423 20079 external_mini_cluster.cc:1428] Setting key cff2cec559984cd021605ff5a2229c4b
Aug 11 18:54:37 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474477, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:37.814270 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:37.797275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39629 (local address 127.19.155.254:46301)
0811 18:54:37.797494 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:37.797500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:37.798606 (+ 1106us) server_negotiation.cc:407] Connection header received
0811 18:54:37.800338 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:37.800343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:37.800411 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:37.800500 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:37.801929 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.802870 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.804675 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.805103 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.805232 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:37.808780 (+ 3548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:37.808785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:37.808788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:37.808818 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:37.811349 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:37.812017 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:37.812024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:37.812028 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:37.812158 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:37.812598 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:37.812603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:37.812606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:37.812870 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:37.813029 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:37.813678 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 18:54:37.813906 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:54:37.815402 31321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:37.797770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:39629)
0811 18:54:37.798442 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:37.798477 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:37.800091 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:37.800697 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:37.800705 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:37.801165 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:37.801737 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:37.801753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.803047 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.803053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:37.804527 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:37.804539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:37.805337 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:37.805345 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:37.805569 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:37.806279 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:37.806300 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:37.808556 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:37.811489 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:37.811497 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:37.811511 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:37.811901 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:37.812294 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:37.812299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:37.812302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:37.812483 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:37.813014 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:37.813022 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:37.813337 (+ 315us) client_negotiation.cc:769] Sending connection context
0811 18:54:37.813601 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 18:54:37.814183 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":261,"threads_started":1}
I20260811 18:54:37.816856 31319 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:37.817175 31319 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:37.817844 31319 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
I20260811 18:54:37.819245 30800 ts_manager.cc:194] Registered new tserver with Master: 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:37.820457 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:39629
WARNING: no policy specified for oryx/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
I20260811 18:54:37.857509 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:38.189899 31324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:38.190172 31324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:38.190366 31324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:38.197302 31324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:38.197441 31324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:38.197659 31324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:38.206851 31324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:38.208177 31324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:38.209450 31324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:38.222936 31339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:38.222975 31335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:38.222867 31336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:38.223829 31324 server_base.cc:1034] running on GCE node
I20260811 18:54:38.224383 31324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:38.225235 31324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:38.226444 31324 hybrid_clock.cc:648] HybridClock initialized: now 1786474478226390 us; error 52 us; skew 500 ppm
I20260811 18:54:38.226706 31324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:38.229969 31324 init.cc:377] Logged in from keytab as oryx/127.19.155.195@KRBTEST.COM (short username oryx)
I20260811 18:54:38.231596 31324 webserver.cc:460] Webserver started at http://127.19.155.195:41343/ using document root <none> and password file <none>
I20260811 18:54:38.232350 31324 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:38.232501 31324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:38.232892 31324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:38.235958 31324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "d4556e8caf9e46ad87b8ddf80a2c6705"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "80c03615f70e32839bc1267ddca044bd"
server_key_iv: "d7d55b1090770a9ff0b9f47e3c0f1065"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.236775 31324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "d4556e8caf9e46ad87b8ddf80a2c6705"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "80c03615f70e32839bc1267ddca044bd"
server_key_iv: "d7d55b1090770a9ff0b9f47e3c0f1065"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.241794 31324 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:38.245203 31350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:38.246452 31324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 18:54:38.246639 31324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "d4556e8caf9e46ad87b8ddf80a2c6705"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "80c03615f70e32839bc1267ddca044bd"
server_key_iv: "d7d55b1090770a9ff0b9f47e3c0f1065"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.246865 31324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:38.267714 31324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:38.272054 31324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:38.272382 31324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:38.273305 31324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:38.274641 31324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:38.274760 31324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:38.274951 31324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:38.275039 31324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 18:54:38.309504 31324 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:35023
I20260811 18:54:38.309559 31522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:35023 every 8 connection(s)
I20260811 18:54:38.310827 31324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:38.319447 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 31324
I20260811 18:54:38.319634 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:38.320122 20079 external_mini_cluster.cc:1428] Setting key aaea1c3fdd2418a9b1eb0c57f68a6e97
I20260811 18:54:38.324357 31093 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:38.331110 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.313559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:33213 (local address 127.19.155.254:46301)
0811 18:54:38.313787 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.313793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.315168 (+ 1375us) server_negotiation.cc:407] Connection header received
0811 18:54:38.316974 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.316979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.317047 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.317138 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.318559 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.319582 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.321360 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.321771 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.321909 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.325816 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.325825 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.325833 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.325874 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.328394 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.329050 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.329054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.329056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.329179 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.329556 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.329559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.329561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.329817 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.329929 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.330620 (+ 691us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.330778 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:54:38.332178 31530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.314155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:33213)
0811 18:54:38.314988 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.315038 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.316687 (+ 1649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.317353 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.317361 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.317862 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.318405 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.318422 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.319747 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.319762 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.321211 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.321225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.322021 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.322030 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.322262 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.323033 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.323087 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.325582 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.328520 (+ 2938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.328528 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.328539 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.328950 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.329282 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.329285 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.329288 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.329462 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.329962 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.329970 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.330300 (+ 330us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.330529 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.330882 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":308,"threads_started":1}
I20260811 18:54:38.333643 31525 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:38.333971 31525 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:38.335026 31525 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
I20260811 18:54:38.336577 30800 ts_manager.cc:194] Registered new tserver with Master: d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023)
I20260811 18:54:38.337389 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:33213
I20260811 18:54:38.347826 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.155.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.253.keytab.
Entry for principal oryx/127.19.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.253.keytab.
I20260811 18:54:38.402551 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:44689
--webserver_interface=127.19.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.253.keytab
--principal=oryx/127.19.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46301,127.19.155.253:44689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:38.741571 31535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:38.741851 31535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:38.741940 31535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:38.749024 31535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:38.749119 31535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:38.749162 31535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:38.749238 31535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:38.749320 31535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:38.759509 31535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46301,127.19.155.253:44689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.253.keytab
--principal=oryx/127.19.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:44689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
W20260811 18:54:38.759868 31535 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.155.254:46301,127.19.155.253:44689'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 18:54:38.760865 31535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:38.762171 31535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:38.774246 31545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:38.774334 31552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:38.774328 31546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:38.775025 31535 server_base.cc:1034] running on GCE node
I20260811 18:54:38.775753 31535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:38.776997 31535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:38.778241 31535 hybrid_clock.cc:648] HybridClock initialized: now 1786474478778181 us; error 56 us; skew 500 ppm
I20260811 18:54:38.778563 31535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:38.781649 31535 init.cc:377] Logged in from keytab as oryx/127.19.155.253@KRBTEST.COM (short username oryx)
I20260811 18:54:38.783090 31535 webserver.cc:460] Webserver started at http://127.19.155.253:42475/ using document root <none> and password file <none>
I20260811 18:54:38.783780 31535 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:38.783916 31535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:38.784233 31535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:38.787180 31535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/instance:
uuid: "356b6d3abaff42dca171dd630b8f191d"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "4876190f7238af076474ae7af6776dfc"
server_key_iv: "432879a938c741ab06d608f3864495d5"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.787976 31535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal/instance:
uuid: "356b6d3abaff42dca171dd630b8f191d"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "4876190f7238af076474ae7af6776dfc"
server_key_iv: "432879a938c741ab06d608f3864495d5"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.793133 31535 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:54:38.796696 31561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:38.797987 31535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:54:38.798174 31535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "356b6d3abaff42dca171dd630b8f191d"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "4876190f7238af076474ae7af6776dfc"
server_key_iv: "432879a938c741ab06d608f3864495d5"
server_key_version: "encryptionkey@0"
I20260811 18:54:38.798399 31535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:38.813378 31535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:38.817441 31535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:38.817703 31535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:38.822799 31319 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
I20260811 18:54:38.837098 31535 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.253:44689
I20260811 18:54:38.837119 31642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.253:44689 every 8 connection(s)
I20260811 18:54:38.838434 31535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
I20260811 18:54:38.842118 31643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:38.845167 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 31535
I20260811 18:54:38.850106 31643 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.253@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:38.867991 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.852969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54958 (local address 127.19.155.254:46301)
0811 18:54:38.853479 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.853486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.853907 (+ 421us) server_negotiation.cc:407] Connection header received
0811 18:54:38.854118 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.854124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.854194 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.854308 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.855664 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.856518 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.858347 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.858732 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.858834 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.862197 (+ 3363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.862202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.862224 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.862257 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.865013 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.865755 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.865762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.865765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.865896 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.866315 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.866321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.866324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.866610 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.866773 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.867408 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.867624 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":249,"threads_started":1}
I20260811 18:54:38.868901 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.853037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:54958)
0811 18:54:38.853774 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.853814 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.853987 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.854365 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.854372 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.855168 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.855509 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.855523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.856663 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.856666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.858164 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.858188 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.859006 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.859016 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.859245 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.859824 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.859853 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.862013 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.865160 (+ 3147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.865171 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.865182 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.865616 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.866008 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.866013 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.866017 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.866196 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.866737 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.866744 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.867053 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.867338 (+ 285us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.867773 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"spinlock_wait_cycles":896,"thread_start_us":393,"threads_started":1}
I20260811 18:54:38.868937 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.847583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42438 (local address 127.19.155.253:44689)
0811 18:54:38.848418 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.848429 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.848470 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:54:38.850089 (+ 1619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.850114 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.850620 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.851074 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.852929 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.854663 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.856213 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.857071 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.857200 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.862342 (+ 5142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.862351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.862361 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.862390 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.865209 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.865905 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.865911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.865913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.866099 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.866497 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.866504 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.866511 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.867031 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.867383 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.867717 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.867954 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"spinlock_wait_cycles":11520,"thread_start_us":387,"threads_started":1}
I20260811 18:54:38.870771 31643 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.253@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:38.881829 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.871407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42444)
0811 18:54:38.871704 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.871730 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.871805 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.872034 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.872036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.872344 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.872465 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.872473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.873371 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.873375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.874194 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.874205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.874822 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.874826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.875003 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.875524 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.875541 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.877353 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.879942 (+ 2589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.879946 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.879948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.880304 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.880625 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.880629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.880631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.880756 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.881193 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.881196 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.881311 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.881417 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.881608 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 18:54:38.881982 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.871611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42444 (local address 127.19.155.253:44689)
0811 18:54:38.871758 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.871762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.871776 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:54:38.871877 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.871881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.871927 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.871999 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.872583 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.873243 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.874313 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.874703 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.874797 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.877514 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.877519 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.877522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.877549 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.879822 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.880401 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.880405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.880407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.880533 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.880845 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.880848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.880850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.881097 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.881202 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.881509 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.881715 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":51}
I20260811 18:54:38.886466 31643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Bootstrap starting.
I20260811 18:54:38.889581 31643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:38.890583 31643 log.cc:824] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:38.893492 31643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: No bootstrap required, opened a new log
I20260811 18:54:38.900606 31643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } }
I20260811 18:54:38.900935 31643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:38.901041 31643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 356b6d3abaff42dca171dd630b8f191d, State: Initialized, Role: FOLLOWER
I20260811 18:54:38.901626 31643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } }
I20260811 18:54:38.902529 31656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } } }
I20260811 18:54:38.902884 31656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:38.903717 31643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:54:38.913105 31673 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:54:38.913254 31673 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:54:38.916216 31535 master_runner.cc:428] Detected that this master 356b6d3abaff42dca171dd630b8f191d is joining an existing cluster
I20260811 18:54:38.916321 31535 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.155.253:44689
I20260811 18:54:38.941864 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.920372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54966 (local address 127.19.155.254:46301)
0811 18:54:38.920580 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.920590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.921202 (+ 612us) server_negotiation.cc:407] Connection header received
0811 18:54:38.921653 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.921659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.921765 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.921843 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.927513 (+ 5670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.928652 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.930809 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.931477 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.931582 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.934421 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.934428 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.934451 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.934494 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.938134 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.939182 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.939190 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.939196 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.939350 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.939885 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.939892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.939898 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.940291 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.940414 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.941108 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.941379 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:38.943120 31679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.920395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:54966)
0811 18:54:38.921102 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.921122 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.921317 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.922073 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.922077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.922770 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.927270 (+ 4500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.927289 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.928864 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.928869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.930626 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.930641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.931907 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.931914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.932144 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.932867 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.932891 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.934197 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.938291 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.938298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.938304 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.939025 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.939507 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.939514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.939520 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.939727 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.940521 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.940528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.940760 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.942133 (+ 1373us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.942477 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"mutex_wait_us":35,"thread_start_us":361,"threads_started":1}
I20260811 18:54:38.943444 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.921382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42458 (local address 127.19.155.253:44689)
0811 18:54:38.921580 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.921586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.922357 (+ 771us) server_negotiation.cc:407] Connection header received
0811 18:54:38.922586 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.922593 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.922669 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.922732 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.928295 (+ 5563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.929397 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.931754 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.932987 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.933123 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.936117 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.936126 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.936133 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.936173 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.940175 (+ 4002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.940973 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.940978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.940981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.941110 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.941541 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.941546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.941549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.941938 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.942226 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.942757 (+ 531us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.943004 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":58}
I20260811 18:54:38.944514 31681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.921226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42458)
0811 18:54:38.922267 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.922283 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.922455 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.922973 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.922977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.927735 (+ 4758us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.928126 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.928142 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.929738 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.929746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.931592 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.931611 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.933537 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.933547 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.933773 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.934464 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.934491 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.935938 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.940315 (+ 4377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.940320 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.940323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.940851 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.941246 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.941252 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.941257 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.941431 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.942295 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.942300 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.942473 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.943710 (+ 1237us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.944069 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"thread_start_us":412,"threads_started":1}
WARNING: no policy specified for oryx/127.19.155.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.252@KRBTEST.COM" created.
Aug 11 18:54:38 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.254@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:38.969631 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.950759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42468)
0811 18:54:38.951881 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:38.951922 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:38.952162 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:38.952923 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:38.952931 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:38.953798 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:38.954084 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.954098 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.955575 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.955583 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.956617 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:38.956630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.957796 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.957800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:38.958001 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.958705 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:38.958731 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:38.961717 (+ 2986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:38.966254 (+ 4537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.966267 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.966274 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.966857 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.967356 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:38.967367 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:38.967373 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:38.967574 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:38.968381 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:38.968390 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:38.968616 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 18:54:38.968854 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 18:54:38.969208 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":620,"threads_started":1}
I20260811 18:54:38.970083 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:38.951097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42468 (local address 127.19.155.253:44689)
0811 18:54:38.951257 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:38.951265 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:38.952010 (+ 745us) server_negotiation.cc:407] Connection header received
0811 18:54:38.952425 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:38.952430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:38.952542 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:38.952613 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:38.954277 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.955407 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.956773 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:38.957627 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:38.957764 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:38.961945 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:38.961954 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:38.961961 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:38.962008 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:38.966105 (+ 4097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.967005 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.967013 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.967020 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.967219 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:38.967750 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:38.967756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:38.967760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:38.968127 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:38.968299 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:38.969021 (+ 722us) server_negotiation.cc:299] Negotiation successful
0811 18:54:38.969286 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 18:54:38.972280 30800 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.155.253:44689: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "356b6d3abaff42dca171dd630b8f191d"
member_type: NON_VOTER
last_known_addr {
host: "127.19.155.253"
port: 44689
}
attrs {
promote: true
}
}
dest_uuid: "1dfb2305c362492c85f5a95b5a32fc1b"
cas_config_opid_index: -1
I20260811 18:54:38.973912 30800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } }
I20260811 18:54:38.985047 31603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:38.985018 31690 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 356b6d3abaff42dca171dd630b8f191d (127.19.155.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } }
I20260811 18:54:38.989436 31603 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 18:54:38.990259 31690 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.155.253:44689
I20260811 18:54:38.991341 31535 master.cc:537] Master@127.19.155.253:44689 shutting down...
I20260811 18:54:38.991066 31691 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:38.991580 31688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } }
I20260811 18:54:38.992012 31688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.252.keytab.
Entry for principal oryx/127.19.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.252.keytab.
W20260811 18:54:38.995217 30771 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 18:54:38.995456 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:36915
--webserver_interface=127.19.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.252.keytab
--principal=oryx/127.19.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:38.998874 30771 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b -> Peer 356b6d3abaff42dca171dd630b8f191d (127.19.155.253:44689): Couldn't send request to peer 356b6d3abaff42dca171dd630b8f191d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:54:39.006567 31535 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:39.007133 31535 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:39.007404 31535 tablet_replica.cc:330] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: stopping tablet replica
I20260811 18:54:39.014133 31535 master.cc:552] Master@127.19.155.253:44689 shutdown complete.
I20260811 18:54:39.014290 31535 master_runner.cc:305] Clearing existing system tablet
I20260811 18:54:39.014724 31535 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:39.014840 31535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:39.017881 31535 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 18:54:39.019480 31698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:39.019838 31535 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:39.020109 31535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:54:39.020210 31535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "356b6d3abaff42dca171dd630b8f191d"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "4876190f7238af076474ae7af6776dfc"
server_key_iv: "432879a938c741ab06d608f3864495d5"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.023591 31535 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:39.028569 31535 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:54:39.028775 31535 log.cc:1196] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 18:54:39.029174 31535 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Deleting consensus metadata
I20260811 18:54:39.029465 31535 master_runner.cc:315] Copying system tablet from 127.19.155.254:46301
I20260811 18:54:39.038443 31535 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: tablet copy: Beginning tablet copy session from remote peer at address 127.19.155.254:46301
I20260811 18:54:39.052068 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.039270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54978 (local address 127.19.155.254:46301)
0811 18:54:39.039490 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.039500 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.040024 (+ 524us) server_negotiation.cc:407] Connection header received
0811 18:54:39.040297 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.040302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.040384 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.040443 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.041411 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.042150 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.043621 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.044194 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.044344 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.046242 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.046249 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.046254 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.046297 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.049211 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.049872 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.049876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.049878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.050002 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.050459 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.050467 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.050471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.050740 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.050979 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.051453 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.051663 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:54:39.052101 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.039240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:54978)
0811 18:54:39.039908 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.039923 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.040101 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.040631 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.040634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.041006 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.041254 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.041265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.042309 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.042314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.043465 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.043481 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.044357 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.044363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.044634 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.045308 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.045326 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.046035 (+ 709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.049348 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.049355 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.049359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.049715 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.050134 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.050139 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.050142 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.050282 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.050868 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.050873 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.051168 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.051359 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.051663 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":398,"threads_started":1}
I20260811 18:54:39.053177 30836 tablet_copy_service.cc:140] P 1dfb2305c362492c85f5a95b5a32fc1b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 356b6d3abaff42dca171dd630b8f191d ({username='oryx', principal='oryx/127.19.155.253@KRBTEST.COM'} at 127.0.0.1:54978)
I20260811 18:54:39.053472 30836 tablet_copy_service.cc:161] P 1dfb2305c362492c85f5a95b5a32fc1b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 356b6d3abaff42dca171dd630b8f191d at {username='oryx', principal='oryx/127.19.155.253@KRBTEST.COM'} at 127.0.0.1:54978: session id = 356b6d3abaff42dca171dd630b8f191d-00000000000000000000000000000000
I20260811 18:54:39.057132 30836 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:54:39.058954 31535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:54:39.063759 31535 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: tablet copy: Starting download of 0 data blocks...
I20260811 18:54:39.064060 31535 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: tablet copy: Starting download of 1 WAL segments...
I20260811 18:54:39.066449 31535 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:54:39.069684 30836 tablet_copy_service.cc:342] P 1dfb2305c362492c85f5a95b5a32fc1b: Request end of tablet copy session 356b6d3abaff42dca171dd630b8f191d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.155.253@KRBTEST.COM'} at 127.0.0.1:54978
I20260811 18:54:39.069905 30836 tablet_copy_service.cc:433] P 1dfb2305c362492c85f5a95b5a32fc1b: ending tablet copy session 356b6d3abaff42dca171dd630b8f191d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 356b6d3abaff42dca171dd630b8f191d
I20260811 18:54:39.081058 31535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:39.084005 31712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:39.088347 31714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:39.093534 31535 server_base.cc:1034] running on GCE node
W20260811 18:54:39.094105 31718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:39.094532 31535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:39.095320 31535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:39.096534 31535 hybrid_clock.cc:648] HybridClock initialized: now 1786474479096442 us; error 68 us; skew 500 ppm
I20260811 18:54:39.096765 31535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:39.098726 31535 init.cc:377] Logged in from keytab as oryx/127.19.155.253@KRBTEST.COM (short username oryx)
I20260811 18:54:39.100019 31535 webserver.cc:460] Webserver started at http://127.19.155.253:33529/ using document root <none> and password file <none>
I20260811 18:54:39.100371 31535 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:39.100467 31535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:39.103227 31535 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 18:54:39.104923 31729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:39.105386 31535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:54:39.105545 31535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "356b6d3abaff42dca171dd630b8f191d"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "4876190f7238af076474ae7af6776dfc"
server_key_iv: "432879a938c741ab06d608f3864495d5"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.105705 31535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:39.140941 31535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:39.145028 31535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:39.178574 31535 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.253:44689
I20260811 18:54:39.178602 31805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.253:44689 every 8 connection(s)
I20260811 18:54:39.179571 31535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
I20260811 18:54:39.186008 31806 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:54:39.189781 31806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Bootstrap starting.
I20260811 18:54:39.213521 31806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:54:39.214087 31806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: Bootstrap complete.
I20260811 18:54:39.215324 31806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } }
I20260811 18:54:39.215612 31806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 356b6d3abaff42dca171dd630b8f191d, State: Initialized, Role: LEARNER
I20260811 18:54:39.215924 31806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } }
I20260811 18:54:39.216747 31809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } }
I20260811 18:54:39.217154 31806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:39.217185 31809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: LEARNER
I20260811 18:54:39.225116 31826 catalog_manager.cc:1259] Loaded cluster ID: e52cc51de3d045e8ba6121d338183009
I20260811 18:54:39.225266 31826 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: loading cluster ID for follower catalog manager: success
I20260811 18:54:39.228631 31826 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: acquiring CA information for follower catalog manager: success
I20260811 18:54:39.230839 31826 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:54:39.339910 31525 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
I20260811 18:54:39.405056 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.397540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42480)
0811 18:54:39.397793 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.397814 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.397957 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.400258 (+ 2301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.400263 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.400295 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:39.400486 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.400495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.401779 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.401784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.403047 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.403060 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.404204 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.404212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.404422 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.404509 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.404632 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.404767 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 18:54:39.405130 31827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.398052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42480 (local address 127.19.155.253:44689)
0811 18:54:39.399917 (+ 1865us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.399922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.399944 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:54:39.400004 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.400008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.400073 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.400210 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:39.400651 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.401625 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.403195 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.404019 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.404236 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.404414 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.404670 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.404804 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1712,"thread_start_us":1545,"threads_started":1}
I20260811 18:54:39.406278 31764 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 18:54:39.406860 31809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dfb2305c362492c85f5a95b5a32fc1b. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } }
I20260811 18:54:39.407122 31809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: LEARNER
W20260811 18:54:39.407874 31696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:39.408181 31696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:39.408346 31696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:39.415643 31696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:39.415789 31696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:39.415885 31696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:39.415984 31696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:39.416059 31696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:39.425828 31696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.252.keytab
--principal=oryx/127.19.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:36915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:39.427157 31696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:39.428472 31696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:39.440332 31832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:39.440450 31833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:39.440538 31839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:39.441330 31696 server_base.cc:1034] running on GCE node
I20260811 18:54:39.442137 31696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:39.443547 31696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:39.444742 31696 hybrid_clock.cc:648] HybridClock initialized: now 1786474479444690 us; error 52 us; skew 500 ppm
I20260811 18:54:39.445071 31696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:39.448184 31696 init.cc:377] Logged in from keytab as oryx/127.19.155.252@KRBTEST.COM (short username oryx)
I20260811 18:54:39.449528 31696 webserver.cc:460] Webserver started at http://127.19.155.252:45785/ using document root <none> and password file <none>
I20260811 18:54:39.450332 31696 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:39.450479 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:39.450779 31696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:39.453742 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/instance:
uuid: "54707dd735ea47e48e1032810d7f0c98"
format_stamp: "Formatted at 2026-08-11 18:54:39 on dist-test-slave-1nl6"
server_key: "760e588c8b14d150138ebad44d676314"
server_key_iv: "80080ed21b8173d1037aaa551b99995e"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.454528 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal/instance:
uuid: "54707dd735ea47e48e1032810d7f0c98"
format_stamp: "Formatted at 2026-08-11 18:54:39 on dist-test-slave-1nl6"
server_key: "760e588c8b14d150138ebad44d676314"
server_key_iv: "80080ed21b8173d1037aaa551b99995e"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.459496 31696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 18:54:39.462836 31848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:39.464109 31696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:54:39.464316 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "54707dd735ea47e48e1032810d7f0c98"
format_stamp: "Formatted at 2026-08-11 18:54:39 on dist-test-slave-1nl6"
server_key: "760e588c8b14d150138ebad44d676314"
server_key_iv: "80080ed21b8173d1037aaa551b99995e"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.464535 31696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:39.485528 31696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:39.489944 31696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:39.490272 31696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:39.511732 31696 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.252:36915
I20260811 18:54:39.511777 31920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.252:36915 every 8 connection(s)
I20260811 18:54:39.513103 31696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
I20260811 18:54:39.516842 31921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:39.521129 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 31696
I20260811 18:54:39.523854 31921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.252@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
I20260811 18:54:39.544126 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.528079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54990 (local address 127.19.155.254:46301)
0811 18:54:39.528308 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.528315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.528910 (+ 595us) server_negotiation.cc:407] Connection header received
0811 18:54:39.529112 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.529118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.529215 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.529328 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.530657 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.531535 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.533261 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.533885 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.534045 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.537426 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.537432 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.537436 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.537475 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.540718 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.541636 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.541640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.541642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.541773 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.542260 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.542265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.542268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.542635 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.542746 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.543569 (+ 823us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.543778 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 18:54:39.545130 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.523335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48990 (local address 127.19.155.252:36915)
0811 18:54:39.524089 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.524101 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.524149 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:54:39.525811 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.525835 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.526259 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.526564 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.528532 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.530309 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.531826 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.532778 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.532968 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.537962 (+ 4994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.537971 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.537982 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.538012 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.541462 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.542260 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.542268 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.542271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.542429 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.542836 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.542839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.542841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.543328 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.543709 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.544223 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.544550 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":547,"thread_start_us":353,"threads_started":1}
I20260811 18:54:39.545202 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.527648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:54990)
0811 18:54:39.528748 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.528795 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.528967 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.529394 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.529402 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.530153 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.530492 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.530503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.531706 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.531711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.533041 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.533053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.534149 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.534157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.534328 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.535008 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.535028 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.537249 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.540866 (+ 3617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.540875 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.540883 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.541486 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.541889 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.541894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.541897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.542131 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.542782 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.542792 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.543172 (+ 380us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.543490 (+ 318us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.543969 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"thread_start_us":707,"threads_started":1}
I20260811 18:54:39.546749 31921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.252@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:39.558553 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.547433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42492)
0811 18:54:39.547583 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.547602 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.547693 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.548201 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.548203 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.548514 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.548636 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.548644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.549629 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.549633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.550618 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.550630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.551381 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.551385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.551564 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.552085 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.552101 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.553919 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.556639 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.556643 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.556645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.557026 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.557348 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.557351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.557353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.557494 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.557943 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.557946 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.558049 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.558160 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.558339 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 18:54:39.558713 31827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.547627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42492 (local address 127.19.155.253:44689)
0811 18:54:39.547825 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.547830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.547851 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:54:39.547896 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.547899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.547952 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.548051 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.548777 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.549520 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.550740 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.551195 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.551352 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.554096 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.554101 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.554104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.554133 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.556516 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.557122 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.557125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.557127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.557258 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.557584 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.557587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.557589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.557848 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.557956 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.558252 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.558412 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:54:39.559685 31921 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.252@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
I20260811 18:54:39.571245 31927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.560262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.0.0.1:48998)
0811 18:54:39.560403 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.560417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.560518 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.560768 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.560772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.561140 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.561276 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.561284 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.562195 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.562201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.563255 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.563267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.563887 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.563892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.564147 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.564677 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.564692 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.566439 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.569112 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.569117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.569121 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.569457 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.569868 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.569872 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.569874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.570023 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.570488 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.570491 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.570611 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.570721 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.570888 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":6}
I20260811 18:54:39.571290 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.560400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48998 (local address 127.19.155.252:36915)
0811 18:54:39.560532 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.560536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.560552 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:54:39.560596 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.560601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.560656 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.560752 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.561401 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.562079 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.563381 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.563752 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.563880 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.566612 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.566617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.566620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.566645 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.568961 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.569566 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.569573 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.569576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.569754 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.570144 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.570148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.570150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.570387 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.570491 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.570809 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.571056 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":48}
I20260811 18:54:39.575938 31921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Bootstrap starting.
I20260811 18:54:39.579052 31921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:39.580019 31921 log.cc:824] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:39.582345 31921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: No bootstrap required, opened a new log
I20260811 18:54:39.589329 31921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } }
I20260811 18:54:39.589622 31921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:39.589737 31921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54707dd735ea47e48e1032810d7f0c98, State: Initialized, Role: FOLLOWER
I20260811 18:54:39.590272 31921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } }
I20260811 18:54:39.591090 31930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } } }
I20260811 18:54:39.591437 31930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:39.592053 31921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:39.600183 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 30899
W20260811 18:54:39.602113 31945 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:54:39.602325 31945 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:54:39.606277 31696 master_runner.cc:428] Detected that this master 54707dd735ea47e48e1032810d7f0c98 is joining an existing cluster
I20260811 18:54:39.606392 31696 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.155.252:36915
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.193@KRBTEST.COM
I20260811 18:54:39.626542 31947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.602302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52626 (local address 127.19.155.193:36435)
0811 18:54:39.602981 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.602990 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.603018 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:54:39.603089 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.603103 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.603309 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.603523 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.605182 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.606714 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.608871 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.609444 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.609517 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.616990 (+ 7473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.617009 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.617032 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.617087 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.622311 (+ 5224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.623483 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.623497 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.623503 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.623748 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.624315 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.624323 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.624327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.624793 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.625095 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.625778 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.626088 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":334,"threads_started":1}
I20260811 18:54:39.629519 31087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:39.643242 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.611523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.19.155.254:46301)
0811 18:54:39.611733 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.611740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.619466 (+ 7726us) server_negotiation.cc:407] Connection header received
0811 18:54:39.619661 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.619666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.619761 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.619859 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.621410 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.622531 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.624666 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.625318 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.625416 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.628163 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.628170 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.628175 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.628227 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.632880 (+ 4653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.639796 (+ 6916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.639802 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.639805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.639971 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.640866 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.640872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.640876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.641260 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.641397 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.642580 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.642824 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:54:39.645380 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.611099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:54996)
0811 18:54:39.619347 (+ 8248us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.619367 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.619527 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.620044 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.620049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.620765 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.621174 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.621247 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.622721 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.622726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.624492 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.624512 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.625734 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.625741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.625932 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.626610 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.626632 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.627955 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.638425 (+ 10470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.638430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.638434 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.639275 (+ 841us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.640150 (+ 875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.640154 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.640158 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.640377 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.641524 (+ 1147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.641529 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.641776 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.643801 (+ 2025us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.644862 (+ 1061us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8103,"thread_start_us":13517,"threads_started":1}
I20260811 18:54:39.647956 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.612026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49000 (local address 127.19.155.252:36915)
0811 18:54:39.612187 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.612193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.624615 (+ 12422us) server_negotiation.cc:407] Connection header received
0811 18:54:39.626255 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.626261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.626328 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.626396 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.629043 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.630630 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.633579 (+ 2949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.635820 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.635966 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.639258 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.639268 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.639275 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.639320 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.644336 (+ 5016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.645393 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.645401 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.645407 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.645592 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.646119 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.646126 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.646132 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.646591 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.646753 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.647360 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.647576 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:54:39.649210 31953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.611544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.0.0.1:49000)
0811 18:54:39.624523 (+ 12979us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.624544 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.625917 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.626630 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.626636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.628510 (+ 1874us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.628897 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.628909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.631171 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.631180 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.633386 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.633409 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.636086 (+ 2677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.636100 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.636374 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.637279 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.637310 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.638955 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.644500 (+ 5545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.644508 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.644515 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.645226 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.645768 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.645775 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.645781 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.645999 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.646842 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.646848 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.647092 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.648368 (+ 1276us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.648703 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12828,"thread_start_us":7516,"threads_started":1}
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.254@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
I20260811 18:54:39.665086 31827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.625283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42504 (local address 127.19.155.253:44689)
0811 18:54:39.625472 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.625479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.646621 (+ 21142us) server_negotiation.cc:407] Connection header received
0811 18:54:39.647383 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.647392 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.647479 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.647556 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.650166 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.651328 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.653515 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.654186 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.654324 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.656572 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.656578 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.656583 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.656628 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.660289 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.662518 (+ 2229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.662524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.662527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.662692 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.663219 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.663226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.663231 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.663611 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.663763 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.664405 (+ 642us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.664691 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:54:39.666437 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.625611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42504)
0811 18:54:39.646515 (+ 20904us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.646538 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.647008 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.647826 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.647831 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.648330 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.648556 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.648570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.651631 (+ 3061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.651638 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.653352 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.653367 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.654330 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.654335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.654574 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.655223 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.655248 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.656365 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.661803 (+ 5438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.661809 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.661821 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.662354 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.662868 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.662874 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.662882 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.663069 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.663881 (+ 812us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.663891 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.664036 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.665587 (+ 1551us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.665997 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20792,"thread_start_us":21509,"threads_started":1}
I20260811 18:54:39.670360 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.654048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.19.155.252:36915)
0811 18:54:39.654574 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.654580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.654595 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:54:39.654681 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.654687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.654839 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.655928 (+ 1089us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.656100 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.657147 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.659064 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.659838 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.660542 (+ 704us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.663517 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.663522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.663526 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.663561 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.667366 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.668188 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.668193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.668196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.668392 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.668896 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.668900 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.668903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.669235 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.669407 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.669798 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.670021 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414}
I20260811 18:54:39.670392 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.653988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.0.0.1:49014)
0811 18:54:39.654234 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.654251 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.654367 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.655049 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.655055 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.655543 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.655767 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.655781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.657342 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.657351 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.658843 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.658859 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.660056 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.660062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.660248 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.660808 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.660830 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.663307 (+ 2477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.667506 (+ 4199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.667512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.667516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.668013 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.668548 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.668553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.668556 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.668729 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.669376 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.669381 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.669535 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.669680 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.669956 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 18:54:39.672042 30800 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.155.252:36915: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "54707dd735ea47e48e1032810d7f0c98"
member_type: NON_VOTER
last_known_addr {
host: "127.19.155.252"
port: 36915
}
attrs {
promote: true
}
}
dest_uuid: "1dfb2305c362492c85f5a95b5a32fc1b"
cas_config_opid_index: 5
I20260811 18:54:39.672955 30800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } }
I20260811 18:54:39.674768 31690 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.677292 31764 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:54:39.679464 31887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:39.684852 31690 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.155.252:36915
I20260811 18:54:39.687922 31887 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:54:39.684875 31957 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260811 18:54:39.689286 31958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.689864 31958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:39.693070 31690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:39.698530 31764 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.704775 31809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: NON_VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: true } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.705137 31809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: LEARNER
I20260811 18:54:39.706503 31958 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: attempting to promote NON_VOTER 356b6d3abaff42dca171dd630b8f191d to VOTER
I20260811 18:54:39.711866 31696 master.cc:537] Master@127.19.155.252:36915 shutting down...
I20260811 18:54:39.714730 31958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } }
I20260811 18:54:39.717093 31764 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 LEARNER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 18:54:39.719049 31961 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 18:54:39.725148 31690 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 356b6d3abaff42dca171dd630b8f191d (127.19.155.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.731644 31760 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 356b6d3abaff42dca171dd630b8f191d (127.19.155.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
W20260811 18:54:39.733155 30769 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b -> Peer 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252:36915): Couldn't send request to peer 54707dd735ea47e48e1032810d7f0c98. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:54:39.735299 31809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.735569 31809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:39.739357 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.739502 31958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.739741 31958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:39.739796 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
W20260811 18:54:39.747267 31855 tablet.cc:2369] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:39.749452 31696 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:39.749893 31696 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:39.750133 31696 tablet_replica.cc:330] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: stopping tablet replica
I20260811 18:54:39.756645 31696 master.cc:552] Master@127.19.155.252:36915 shutdown complete.
I20260811 18:54:39.756748 31696 master_runner.cc:305] Clearing existing system tablet
I20260811 18:54:39.757097 31696 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:39.757236 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:39.763593 31696 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.002s
I20260811 18:54:39.765139 31968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:39.765502 31696 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:39.765793 31696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:54:39.765897 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "54707dd735ea47e48e1032810d7f0c98"
format_stamp: "Formatted at 2026-08-11 18:54:39 on dist-test-slave-1nl6"
server_key: "760e588c8b14d150138ebad44d676314"
server_key_iv: "80080ed21b8173d1037aaa551b99995e"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.769356 31696 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:39.774299 31696 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:54:39.774497 31696 log.cc:1196] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 18:54:39.774981 31696 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Deleting consensus metadata
I20260811 18:54:39.775243 31696 master_runner.cc:315] Copying system tablet from 127.19.155.254:46301
I20260811 18:54:39.777753 31696 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: tablet copy: Beginning tablet copy session from remote peer at address 127.19.155.254:46301
I20260811 18:54:39.796344 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.778563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55012 (local address 127.19.155.254:46301)
0811 18:54:39.778841 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:39.778851 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:39.783551 (+ 4700us) server_negotiation.cc:407] Connection header received
0811 18:54:39.783775 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:39.783781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:39.783868 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:39.783978 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:39.784910 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.785634 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.786964 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.787413 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.787548 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.789469 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:39.789478 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:39.789488 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:39.789521 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:39.792503 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.793518 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.793524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.793527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.793754 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:39.794325 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:39.794333 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:39.794339 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:39.794825 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:39.795015 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:39.795686 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 18:54:39.795956 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 18:54:39.797583 31979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:39.778509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55012)
0811 18:54:39.783423 (+ 4914us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:39.783446 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:39.783630 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:39.784015 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:39.784020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:39.784493 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:39.784738 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.784748 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.785792 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.785798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.786774 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:39.786789 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:39.787588 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:39.787594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:39.787767 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:39.788452 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:39.788469 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:39.789232 (+ 763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:39.792685 (+ 3453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.792691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.792695 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.793357 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.793951 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:39.793955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:39.793960 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:39.794133 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:39.795132 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:39.795137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:39.795372 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 18:54:39.796641 (+ 1269us) client_negotiation.cc:240] Negotiation successful
0811 18:54:39.797136 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4757,"thread_start_us":4649,"threads_started":1}
I20260811 18:54:39.798246 30836 tablet_copy_service.cc:140] P 1dfb2305c362492c85f5a95b5a32fc1b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 54707dd735ea47e48e1032810d7f0c98 ({username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:55012)
I20260811 18:54:39.798460 30836 tablet_copy_service.cc:161] P 1dfb2305c362492c85f5a95b5a32fc1b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 54707dd735ea47e48e1032810d7f0c98 at {username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:55012: session id = 54707dd735ea47e48e1032810d7f0c98-00000000000000000000000000000000
I20260811 18:54:39.800956 30836 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:54:39.803117 31696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:54:39.803926 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 30899
I20260811 18:54:39.809826 31696 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: tablet copy: Starting download of 0 data blocks...
I20260811 18:54:39.810122 31696 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: tablet copy: Starting download of 1 WAL segments...
I20260811 18:54:39.814391 31696 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:54:39.817840 30836 tablet_copy_service.cc:342] P 1dfb2305c362492c85f5a95b5a32fc1b: Request end of tablet copy session 54707dd735ea47e48e1032810d7f0c98-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:55012
I20260811 18:54:39.817988 30836 tablet_copy_service.cc:433] P 1dfb2305c362492c85f5a95b5a32fc1b: ending tablet copy session 54707dd735ea47e48e1032810d7f0c98-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 54707dd735ea47e48e1032810d7f0c98
I20260811 18:54:39.829178 31696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:39.834038 31980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:39.836290 31981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:39.840711 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:36435
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:46301
--webserver_port=42833
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:39.847817 31983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:39.849649 31696 server_base.cc:1034] running on GCE node
I20260811 18:54:39.850170 31696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:39.850862 31696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:39.852061 31696 hybrid_clock.cc:648] HybridClock initialized: now 1786474479852077 us; error 79 us; skew 500 ppm
I20260811 18:54:39.852299 31696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:39 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474479, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:39.854169 31696 init.cc:377] Logged in from keytab as oryx/127.19.155.252@KRBTEST.COM (short username oryx)
I20260811 18:54:39.859720 31696 webserver.cc:460] Webserver started at http://127.19.155.252:37843/ using document root <none> and password file <none>
I20260811 18:54:39.860013 31696 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:39.860129 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:39.862365 31696 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 18:54:39.864094 31997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:39.864533 31696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:54:39.864660 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "54707dd735ea47e48e1032810d7f0c98"
format_stamp: "Formatted at 2026-08-11 18:54:39 on dist-test-slave-1nl6"
server_key: "760e588c8b14d150138ebad44d676314"
server_key_iv: "80080ed21b8173d1037aaa551b99995e"
server_key_version: "encryptionkey@0"
I20260811 18:54:39.864857 31696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:39.876111 31696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:39.879485 31696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:39.912968 31696 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.252:36915
I20260811 18:54:39.913141 32080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.252:36915 every 8 connection(s)
I20260811 18:54:39.913913 31696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
I20260811 18:54:39.922078 32081 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:54:39.927495 32081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Bootstrap starting.
I20260811 18:54:39.952188 32081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:54:39.952652 32081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Bootstrap complete.
I20260811 18:54:39.953594 32081 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } }
I20260811 18:54:39.953876 32081 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 54707dd735ea47e48e1032810d7f0c98, State: Initialized, Role: LEARNER
I20260811 18:54:39.954123 32081 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } }
I20260811 18:54:39.954955 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:39.955283 32081 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:39.955436 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: LEARNER
I20260811 18:54:39.963356 32108 catalog_manager.cc:1259] Loaded cluster ID: e52cc51de3d045e8ba6121d338183009
I20260811 18:54:39.963546 32108 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: loading cluster ID for follower catalog manager: success
I20260811 18:54:39.966280 32108 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: acquiring CA information for follower catalog manager: success
I20260811 18:54:39.968103 32108 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:54:40.112897 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.104000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.0.0.1:49016)
0811 18:54:40.104277 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.104297 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.104431 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.105496 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.105504 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.105546 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:40.105784 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.105801 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.107922 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.107932 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.110118 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.110138 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.111998 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.112007 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.112236 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.112282 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 18:54:40.112403 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 18:54:40.112557 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260811 18:54:40.113114 32109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.104285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49016 (local address 127.19.155.252:36915)
0811 18:54:40.105012 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.105019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.105046 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:54:40.105150 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.105155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.105260 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.105403 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:40.105970 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.107744 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.110362 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.111795 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.112023 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.112229 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:40.112441 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 18:54:40.112599 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":363,"threads_started":1}
I20260811 18:54:40.114604 32044 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 18:54:40.115465 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dfb2305c362492c85f5a95b5a32fc1b. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:40.115800 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: LEARNER
W20260811 18:54:40.238060 31985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:40.238417 31985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:40.238585 31985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:40.246259 31985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:40.246410 31985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:40.246589 31985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:40.256546 31985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:36435
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=42833
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:40.257828 31985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:40.259290 31985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:40.272898 32115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:40.272964 32116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:40.272924 32123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:40.274111 31985 server_base.cc:1034] running on GCE node
I20260811 18:54:40.274701 31985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:40.275641 31985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:40.276875 31985 hybrid_clock.cc:648] HybridClock initialized: now 1786474480276817 us; error 43 us; skew 500 ppm
I20260811 18:54:40.277182 31985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:40.280340 31985 init.cc:377] Logged in from keytab as oryx/127.19.155.193@KRBTEST.COM (short username oryx)
I20260811 18:54:40.281687 31985 webserver.cc:460] Webserver started at http://127.19.155.193:42833/ using document root <none> and password file <none>
I20260811 18:54:40.282344 31985 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:40.282502 31985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:40.287693 31985 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 18:54:40.290230 32133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.291546 31985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:40.291723 31985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "df927cef084e47349faca1a5721b0db4"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "adb67aaead5def84e47c1ea5845f131f"
server_key_iv: "924fa3012674e8e7e361617d8cb6d467"
server_key_version: "encryptionkey@0"
I20260811 18:54:40.292706 31985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:40.325021 31985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:40.329448 31985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:40.329814 31985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:40.330838 31985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:40.332465 31985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:40.332587 31985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.332711 31985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:40.332811 31985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.368379 31985 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36435
I20260811 18:54:40.368475 32298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36435 every 8 connection(s)
I20260811 18:54:40.369843 31985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:40.372543 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 31985
I20260811 18:54:40.372833 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 31104
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.194@KRBTEST.COM
I20260811 18:54:40.401052 32306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.373987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40166 (local address 127.19.155.194:42735)
0811 18:54:40.375052 (+ 1065us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.375094 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.376203 (+ 1109us) server_negotiation.cc:407] Connection header received
0811 18:54:40.376297 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.376304 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.376612 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.376790 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.379764 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.381771 (+ 2007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.384308 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.385449 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.385601 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.392879 (+ 7278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:40.392895 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:40.392910 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:40.392957 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:40.396890 (+ 3933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.397828 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.397837 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.397841 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.397995 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.398480 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.398485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.398489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.398883 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:40.399224 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:40.400319 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0811 18:54:40.400580 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":666,"threads_started":1}
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
I20260811 18:54:40.402498 31310 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:40.414083 32109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.374164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:36639 (local address 127.19.155.252:36915)
0811 18:54:40.374418 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.374428 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.390641 (+ 16213us) server_negotiation.cc:407] Connection header received
0811 18:54:40.391204 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.391210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.391300 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.391381 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.394120 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.395283 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.398063 (+ 2780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.398763 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.398862 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.405896 (+ 7034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:40.405903 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:40.405908 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:40.405947 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:40.409562 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.410615 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.410622 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.410627 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.410805 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.411371 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.411379 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.411383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.411779 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:40.411917 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:40.413478 (+ 1561us) server_negotiation.cc:299] Negotiation successful
0811 18:54:40.413721 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:54:40.415189 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.375977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.19.155.193:36639)
0811 18:54:40.390526 (+ 14549us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.390552 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.391035 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.391816 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.391827 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.392958 (+ 1131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.393894 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.393922 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.395544 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.395552 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.397888 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.397906 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.399213 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.399220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.399468 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.400191 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:40.400222 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:40.403815 (+ 3593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:40.409718 (+ 5903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.409727 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.409745 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.410456 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.410988 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.410992 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.410996 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.411225 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.412036 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:40.412045 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:40.412510 (+ 465us) client_negotiation.cc:769] Sending connection context
0811 18:54:40.412944 (+ 434us) client_negotiation.cc:240] Negotiation successful
0811 18:54:40.413486 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14396,"mutex_wait_us":31,"spinlock_wait_cycles":57472,"thread_start_us":14529,"threads_started":1}
I20260811 18:54:40.415848 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.377444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:57993)
0811 18:54:40.394404 (+ 16960us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.394418 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.394554 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.394882 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.394885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.395354 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.395650 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.395659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.396918 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.396925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.398487 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.398501 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.400037 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.400185 (+ 148us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.400435 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.401100 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:40.401126 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:40.404634 (+ 3508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:40.412408 (+ 7774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.412413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.412416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.413019 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.413460 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.413464 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.413467 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.413680 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.414771 (+ 1091us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:40.414776 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:40.414950 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 18:54:40.415127 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 18:54:40.415395 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16846,"mutex_wait_us":1,"thread_start_us":16724,"threads_started":1}
I20260811 18:54:40.416862 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.377571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57993 (local address 127.19.155.254:46301)
0811 18:54:40.393886 (+ 16315us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.393897 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.394510 (+ 613us) server_negotiation.cc:407] Connection header received
0811 18:54:40.394666 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.394672 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.394747 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.394859 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.395828 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.396786 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.398657 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.399339 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.399457 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.404888 (+ 5431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:40.404895 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:40.404900 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:40.404940 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:40.412229 (+ 7289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.413166 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.413173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.413177 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.413329 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.413826 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.413831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.413835 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.414551 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:40.414694 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:40.416264 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0811 18:54:40.416481 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16143,"thread_start_us":16313,"threads_started":1}
I20260811 18:54:40.416934 32309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.375979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.19.155.193:50783)
0811 18:54:40.376940 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.377001 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.390071 (+ 13070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.392064 (+ 1993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.392072 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.397940 (+ 5868us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.398276 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.398287 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.400166 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.400171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.403174 (+ 3003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.403196 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.404456 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.404467 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.404648 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.405305 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:40.405328 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:40.408077 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:40.412661 (+ 4584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.412666 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.412669 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.413243 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.414982 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:40.414987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:40.414993 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:40.415230 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:40.415960 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:40.415965 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:40.416177 (+ 212us) client_negotiation.cc:769] Sending connection context
0811 18:54:40.416328 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 18:54:40.416572 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":429,"threads_started":1}
I20260811 18:54:40.417951 32308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.373954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:50783 (local address 127.19.155.253:44689)
0811 18:54:40.375438 (+ 1484us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.375446 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.377094 (+ 1648us) server_negotiation.cc:407] Connection header received
0811 18:54:40.390832 (+ 13738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.390842 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.390982 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.391083 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.398452 (+ 7369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.399677 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.403387 (+ 3710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.404025 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.404140 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.408311 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:40.408317 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:40.408321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:40.408365 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:40.412466 (+ 4101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.414668 (+ 2202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.414673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.414676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.414826 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:40.415362 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:40.415366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:40.415370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:40.415715 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:40.415881 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:40.417334 (+ 1453us) server_negotiation.cc:299] Negotiation successful
0811 18:54:40.417579 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1352,"thread_start_us":1245,"threads_started":1}
I20260811 18:54:40.418316 32302 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:40.418630 32302 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:40.418852 32303 heartbeater.cc:347] Connected to a master server at 127.19.155.253:44689
I20260811 18:54:40.419057 32303 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:40.419178 32300 heartbeater.cc:347] Connected to a master server at 127.19.155.252:36915
I20260811 18:54:40.419340 32300 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:40.419664 32302 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
I20260811 18:54:40.419746 32303 heartbeater.cc:511] Master 127.19.155.253:44689 requested a full tablet report, sending...
I20260811 18:54:40.419849 32300 heartbeater.cc:511] Master 127.19.155.252:36915 requested a full tablet report, sending...
I20260811 18:54:40.421609 30800 ts_manager.cc:194] Re-registered known tserver with Master: df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435)
I20260811 18:54:40.422506 31749 ts_manager.cc:194] Registered new tserver with Master: df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435)
I20260811 18:54:40.422888 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:57993
I20260811 18:54:40.424428 32024 ts_manager.cc:194] Registered new tserver with Master: df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435)
I20260811 18:54:40.492499 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 31104
I20260811 18:54:40.517220 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:42735
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:46301
--webserver_port=34357
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:54:40.635028 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: NON_VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: true } } }
I20260811 18:54:40.635398 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:40.636987 32319 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: attempting to promote NON_VOTER 54707dd735ea47e48e1032810d7f0c98 to VOTER
I20260811 18:54:40.637547 32319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } }
I20260811 18:54:40.639365 31764 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 18:54:40.639389 32044 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 LEARNER]: Refusing update from remote peer 1dfb2305c362492c85f5a95b5a32fc1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 18:54:40.640049 32319 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 18:54:40.640437 32322 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 18:54:40.643517 32319 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.644055 31764 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.645258 32044 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.647715 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.647990 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:40.648205 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.648490 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:40.655471 32326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.656255 32327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.656741 32327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:40.657219 32319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:40.657495 32319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:40.659047 32326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:54:40.860611 32318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:40.860865 32318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:40.860960 32318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:40.868300 32318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:40.868396 32318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:40.868505 32318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:40.878230 32318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:42735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=34357
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:40.879534 32318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:40.880905 32318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:40.893839 32333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:40.894348 32338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:40.894398 32332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:40.894816 32318 server_base.cc:1034] running on GCE node
I20260811 18:54:40.895470 32318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:40.896384 32318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:40.897641 32318 hybrid_clock.cc:648] HybridClock initialized: now 1786474480897575 us; error 56 us; skew 500 ppm
I20260811 18:54:40.897966 32318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:40.901187 32318 init.cc:377] Logged in from keytab as oryx/127.19.155.194@KRBTEST.COM (short username oryx)
I20260811 18:54:40.902590 32318 webserver.cc:460] Webserver started at http://127.19.155.194:34357/ using document root <none> and password file <none>
I20260811 18:54:40.903293 32318 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:40.903416 32318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:40.908679 32318 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 18:54:40.911373 32346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.912662 32318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:40.912832 32318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "82a83bf9841a42e2beb310f5fde614d0"
format_stamp: "Formatted at 2026-08-11 18:54:37 on dist-test-slave-1nl6"
server_key: "e5d8e4ef73b266fa0b4a75df8808b661"
server_key_iv: "ce7e8b691240c3819663b2a3dcc846a7"
server_key_version: "encryptionkey@0"
I20260811 18:54:40.913779 32318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:40.928500 32318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:40.932380 32318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:40.932663 32318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:40.933545 32318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:40.934871 32318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:40.935024 32318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.935107 32318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:40.935173 32318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:40.969219 32318 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:42735
I20260811 18:54:40.969312 32512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:42735 every 8 connection(s)
I20260811 18:54:40.970667 32318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:40.972012 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 32318
I20260811 18:54:40.972348 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 31324
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
Aug 11 18:54:40 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.195@KRBTEST.COM
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474480, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:41.012029 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.975330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:53771 (local address 127.19.155.254:46301)
0811 18:54:40.976452 (+ 1122us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.976462 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.989170 (+ 12708us) server_negotiation.cc:407] Connection header received
0811 18:54:40.989349 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.989354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.989434 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.989550 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.994947 (+ 5397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.996087 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.998250 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.998930 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.999049 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.003750 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.003758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.003762 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.003818 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.007846 (+ 4028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.008910 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.008919 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.008925 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.009091 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.009735 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.009740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.009744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.010080 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.010227 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.011363 (+ 1136us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.011602 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":949,"thread_start_us":824,"threads_started":1}
I20260811 18:54:41.014029 32522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.974377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.19.155.194:50925)
0811 18:54:40.984095 (+ 9718us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.984158 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.987479 (+ 3321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.990066 (+ 2587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.990081 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.991000 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.992085 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.992116 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.993996 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.994005 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.997446 (+ 3441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.997461 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.998743 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.998752 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.999183 (+ 431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:40.999970 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.000004 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.003881 (+ 3877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.009421 (+ 5540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.009427 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.009431 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.009990 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.010471 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.010478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.010481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.010663 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.011376 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.011384 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.011586 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.011736 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.012488 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9351,"mutex_wait_us":85,"thread_start_us":9083,"threads_started":1}
I20260811 18:54:41.014066 32528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.989414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:49873 (local address 127.19.155.253:44689)
0811 18:54:40.994048 (+ 4634us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.994054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.995384 (+ 1330us) server_negotiation.cc:407] Connection header received
0811 18:54:40.995580 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.995590 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.995678 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.995761 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.997351 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.998544 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.000976 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.001845 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.001966 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.006595 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.006605 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.006611 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.006676 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.010826 (+ 4150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.011730 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.011736 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.011740 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.011876 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.012389 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.012394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.012398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.012776 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.012927 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.013500 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.013713 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4508,"thread_start_us":4377,"threads_started":1}
I20260811 18:54:41.014060 32524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.975269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:53771)
0811 18:54:40.989070 (+ 13801us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.989088 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.989210 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.990069 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.990082 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.994385 (+ 4303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.994748 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.994762 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.996350 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.996359 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.998063 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.998078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.999315 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.999323 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:40.999523 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.000101 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.000121 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.003474 (+ 3353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.008031 (+ 4557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.008041 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.008059 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.008759 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.009303 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.009310 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.009314 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.009572 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.010345 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.010353 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.010831 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.012346 (+ 1515us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.012685 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13646,"mutex_wait_us":32,"thread_start_us":13476,"threads_started":1}
I20260811 18:54:41.014499 32520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.973664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.19.155.195:35023)
0811 18:54:40.984380 (+ 10716us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.984389 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.988438 (+ 4049us) server_negotiation.cc:407] Connection header received
0811 18:54:40.988648 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.988660 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.988919 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.989092 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.991595 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.993458 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.995622 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.996649 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.996773 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.005379 (+ 8606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.005401 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.005420 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.005475 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.009650 (+ 4175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.010557 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.010566 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.010570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.010756 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.011285 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.011293 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.011296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.011736 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.012007 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.013498 (+ 1491us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.013763 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10509,"thread_start_us":10708,"threads_started":1}
I20260811 18:54:41.015040 32529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.992453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.19.155.194:49873)
0811 18:54:40.995263 (+ 2810us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:40.995282 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:40.995406 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:40.996005 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:40.996010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:40.996695 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:40.997144 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:40.997159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.998754 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.998761 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.000771 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.000792 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.002282 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.002286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.002512 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.003160 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.003183 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.006063 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.011018 (+ 4955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.011023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.011027 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.011595 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.012022 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.012028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.012031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.012250 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.013013 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.013018 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.013194 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.014306 (+ 1112us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.014614 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2684,"mutex_wait_us":3,"spinlock_wait_cycles":22272,"thread_start_us":2566,"threads_started":1}
I20260811 18:54:41.015972 31517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:41.016522 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:40.975768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:50925 (local address 127.19.155.252:36915)
0811 18:54:40.989521 (+ 13753us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:40.989527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:40.989546 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:40.989610 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:40.989616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:40.989698 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:40.990922 (+ 1224us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:40.992367 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.993771 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.997638 (+ 3867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:40.998344 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:40.998453 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.004159 (+ 5706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.004166 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.004172 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.004214 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.009259 (+ 5045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.010149 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.010154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.010157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.010310 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.010839 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.010844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.010849 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.011231 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.015206 (+ 3975us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.015932 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.016216 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13633,"thread_start_us":12718,"threads_started":1}
I20260811 18:54:41.016571 32517 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:41.016637 32518 heartbeater.cc:347] Connected to a master server at 127.19.155.253:44689
I20260811 18:54:41.016886 32518 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.016894 32517 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.017563 32515 heartbeater.cc:347] Connected to a master server at 127.19.155.252:36915
I20260811 18:54:41.017730 32515 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.018260 32517 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
I20260811 18:54:41.018517 32515 heartbeater.cc:511] Master 127.19.155.252:36915 requested a full tablet report, sending...
I20260811 18:54:41.019119 32518 heartbeater.cc:511] Master 127.19.155.253:44689 requested a full tablet report, sending...
I20260811 18:54:41.020195 30800 ts_manager.cc:194] Re-registered known tserver with Master: 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:41.020258 32024 ts_manager.cc:194] Registered new tserver with Master: 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:41.021711 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:53771
I20260811 18:54:41.023041 31749 ts_manager.cc:194] Registered new tserver with Master: 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:41.106390 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 31324
I20260811 18:54:41.134164 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:35023
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:46301
--webserver_port=41343
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:54:41.425280 32302 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
W20260811 18:54:41.476511 32532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:41.476773 32532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:41.476960 32532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:41.484122 32532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:41.484251 32532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:41.484428 32532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:41.494197 32532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:35023
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=41343
--tserver_master_addrs=127.19.155.254:46301,127.19.155.253:44689,127.19.155.252:36915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:41.495581 32532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:41.496975 32532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:41.511327 32540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:41.511430 32541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:41.511981 32545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:41.512008 32532 server_base.cc:1034] running on GCE node
I20260811 18:54:41.512696 32532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:41.513653 32532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:41.514889 32532 hybrid_clock.cc:648] HybridClock initialized: now 1786474481514838 us; error 43 us; skew 500 ppm
I20260811 18:54:41.515266 32532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474481, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:41.519078 32532 init.cc:377] Logged in from keytab as oryx/127.19.155.195@KRBTEST.COM (short username oryx)
I20260811 18:54:41.520689 32532 webserver.cc:460] Webserver started at http://127.19.155.195:41343/ using document root <none> and password file <none>
I20260811 18:54:41.521463 32532 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:41.521625 32532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:41.527123 32532 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:41.529769 32556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:41.531196 32532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:41.531373 32532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "d4556e8caf9e46ad87b8ddf80a2c6705"
format_stamp: "Formatted at 2026-08-11 18:54:38 on dist-test-slave-1nl6"
server_key: "80c03615f70e32839bc1267ddca044bd"
server_key_iv: "d7d55b1090770a9ff0b9f47e3c0f1065"
server_key_version: "encryptionkey@0"
I20260811 18:54:41.532454 32532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:41.547585 32532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:41.551869 32532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:41.552173 32532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:41.553102 32532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:41.554401 32532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:41.554526 32532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:41.554652 32532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:41.554759 32532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:41.589112 32532 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:35023
I20260811 18:54:41.589196 32720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:35023 every 8 connection(s)
I20260811 18:54:41.590544 32532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:41.598766 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 32532
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474481, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.252@KRBTEST.COM
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474481, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
Aug 11 18:54:41 dist-test-slave-1nl6 krb5kdc[30721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474481, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.253@KRBTEST.COM
I20260811 18:54:41.624102 32726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.593531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59895 (local address 127.19.155.254:46301)
0811 18:54:41.594028 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.594035 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.595612 (+ 1577us) server_negotiation.cc:407] Connection header received
0811 18:54:41.598979 (+ 3367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.598985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.599080 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.599172 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.602576 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.604121 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.607769 (+ 3648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.608593 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.608709 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.615177 (+ 6468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.615187 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.615195 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.615251 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.620066 (+ 4815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.621291 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.621299 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.621305 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.621531 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.622103 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.622111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.622116 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.622566 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.622719 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.623467 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.623715 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":476,"threads_started":1}
I20260811 18:54:41.624845 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.594080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.19.155.195:43591)
0811 18:54:41.595238 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.595301 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.598587 (+ 3286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.599816 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.599824 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.600981 (+ 1157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:41.602320 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.602350 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.604413 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.604422 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.607551 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.607572 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.609247 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.609257 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.609784 (+ 527us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.610880 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.610940 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.614508 (+ 3568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.619582 (+ 5074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.619591 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.619608 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.620328 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.620847 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.620854 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.620859 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.621150 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.622011 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.622020 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.622480 (+ 460us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.622823 (+ 343us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.623450 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":563,"spinlock_wait_cycles":150272,"thread_start_us":495,"threads_started":1}
I20260811 18:54:41.624944 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.594079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:59895)
0811 18:54:41.595238 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.595301 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.598594 (+ 3293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.599681 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.599692 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.600983 (+ 1291us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:41.602317 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.602350 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.604411 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.604419 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.607556 (+ 3137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.607576 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.609246 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.609254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.609775 (+ 521us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.610935 (+ 1160us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.610978 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.614863 (+ 3885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.620263 (+ 5400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.620271 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.620276 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.621106 (+ 830us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.621722 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.621730 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.621737 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.621951 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.622856 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.622863 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.623102 (+ 239us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.623314 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.623668 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":461,"spinlock_wait_cycles":12288,"thread_start_us":461,"threads_started":1}
I20260811 18:54:41.626155 32729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.593907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:43591 (local address 127.19.155.252:36915)
0811 18:54:41.594448 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.594473 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.595410 (+ 937us) server_negotiation.cc:407] Connection header received
0811 18:54:41.599256 (+ 3846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.599267 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.599407 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.599510 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.602584 (+ 3074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.604150 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.607765 (+ 3615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.608650 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.608776 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.614777 (+ 6001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.614783 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.614788 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.614829 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.619405 (+ 4576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.620513 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.620520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.620526 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.620696 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.621314 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.621320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.621323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.621790 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.621931 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.625539 (+ 3608us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.625761 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":345,"threads_started":1}
I20260811 18:54:41.626796 32722 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46301
I20260811 18:54:41.627158 32722 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.627979 32722 heartbeater.cc:511] Master 127.19.155.254:46301 requested a full tablet report, sending...
I20260811 18:54:41.628479 32721 heartbeater.cc:347] Connected to a master server at 127.19.155.252:36915
I20260811 18:54:41.628631 32721 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.629189 32721 heartbeater.cc:511] Master 127.19.155.252:36915 requested a full tablet report, sending...
I20260811 18:54:41.630081 30800 ts_manager.cc:194] Re-registered known tserver with Master: d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023)
I20260811 18:54:41.630509 32024 ts_manager.cc:194] Registered new tserver with Master: d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023)
I20260811 18:54:41.631228 30800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:59895
I20260811 18:54:41.636873 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.595784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.19.155.195:58217)
0811 18:54:41.596488 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.596513 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.598891 (+ 2378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.612554 (+ 13663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.612562 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.613145 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:41.613486 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.613503 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.615229 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.615234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.616661 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.616673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.617945 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.617952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.618175 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.618784 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:41.618809 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:41.621590 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:41.633373 (+ 11783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.633379 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.633384 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.633812 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.634249 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:41.634254 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:41.634261 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:41.634449 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:41.635458 (+ 1009us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:41.635466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:41.635689 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.635886 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.636352 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":375,"threads_started":1}
I20260811 18:54:41.638252 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.595960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:58217 (local address 127.19.155.253:44689)
0811 18:54:41.611283 (+ 15323us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.611289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.611309 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:41.611375 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.611381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.611485 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.611601 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.613958 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.615070 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.616913 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.617712 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.618546 (+ 834us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.621910 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.621916 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.621920 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.621969 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.633214 (+ 11245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.633937 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.633943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.633946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.634107 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.634862 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.634866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.634868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.635306 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.637198 (+ 1892us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.637370 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.637667 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15180,"thread_start_us":15761,"threads_started":1}
I20260811 18:54:41.639567 32723 heartbeater.cc:347] Connected to a master server at 127.19.155.253:44689
I20260811 18:54:41.639734 32723 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:41.640277 32723 heartbeater.cc:511] Master 127.19.155.253:44689 requested a full tablet report, sending...
I20260811 18:54:41.641811 31749 ts_manager.cc:194] Registered new tserver with Master: d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023)
I20260811 18:54:41.658953 32726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.629291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.19.155.254:46301)
0811 18:54:41.629652 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.629658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.634394 (+ 4736us) server_negotiation.cc:407] Connection header received
0811 18:54:41.634591 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.634596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.634675 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.634746 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.642652 (+ 7906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.644270 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.647401 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.648426 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.648565 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.652163 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.652170 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.652175 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.652217 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.655421 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.656515 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.656521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.656525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.656708 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.657228 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.657234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.657237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.657643 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.657903 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.658286 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.658548 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244}
I20260811 18:54:41.662293 32729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.629002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49026 (local address 127.19.155.252:36915)
0811 18:54:41.629157 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.629163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.635269 (+ 6106us) server_negotiation.cc:407] Connection header received
0811 18:54:41.637544 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.637553 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.637668 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.637754 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.644767 (+ 7013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.646180 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.650200 (+ 4020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.650971 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.651124 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.654472 (+ 3348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.654481 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.654486 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.654527 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.658605 (+ 4078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.659454 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.659459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.659463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.659601 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.660065 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.660073 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.660078 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.660474 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.660766 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.661720 (+ 954us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.661944 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:54:41.664886 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.635348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42518 (local address 127.19.155.253:44689)
0811 18:54:41.638572 (+ 3224us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.638579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.648016 (+ 9437us) server_negotiation.cc:407] Connection header received
0811 18:54:41.648205 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.648232 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.648327 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.648423 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.650781 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.651901 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.653997 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.654589 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.654738 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.657755 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:41.657761 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:41.657765 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:41.657803 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:41.661466 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.662283 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.662289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.662294 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.662605 (+ 311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:41.663133 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:41.663138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:41.663141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:41.663695 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:41.663945 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.664219 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.664450 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3071,"thread_start_us":12504,"threads_started":1}
I20260811 18:54:41.663631 30800 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:41.671526 30800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:41.712261 301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.690547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34436 (local address 127.19.155.195:35023)
0811 18:54:41.703405 (+ 12858us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.703429 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.703474 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:54:41.703607 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.703619 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.703944 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.704222 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:41.704822 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.707376 (+ 2554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.709876 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.711097 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.711290 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.711491 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.711701 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.711905 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12621,"thread_start_us":13979,"threads_started":1}
I20260811 18:54:41.712308 32767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.690405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:35023 (local address 127.0.0.1:34436)
0811 18:54:41.691112 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.691132 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.691261 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.704144 (+ 12883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.704148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.704171 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:41.704594 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.704609 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.707517 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.707523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.709703 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.709718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.711311 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.711318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.711509 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.711544 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.711633 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.711818 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":25,"thread_start_us":374,"threads_started":1}
I20260811 18:54:41.718128 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.691170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36435 (local address 127.0.0.1:52628)
0811 18:54:41.703953 (+ 12783us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.703978 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.704118 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.706127 (+ 2009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.706131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.706157 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:41.706623 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.706636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.711112 (+ 4476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.711117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.713822 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.713836 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.717123 (+ 3287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.717131 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.717345 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.717379 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.717480 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.717686 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12612,"mutex_wait_us":26,"thread_start_us":1208,"threads_started":1}
I20260811 18:54:41.718923 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.691717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.19.155.193:36435)
0811 18:54:41.693089 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.693099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.704078 (+ 10979us) server_negotiation.cc:407] Connection header received
0811 18:54:41.705384 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.705393 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.705673 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.705863 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:41.706828 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.710958 (+ 4130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.714026 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.716582 (+ 2556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.716776 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.716968 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.718352 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.718539 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1206,"thread_start_us":1066,"threads_started":1}
I20260811 18:54:41.719602 32641 tablet_service.cc:1467] Processing CreateTablet for tablet 58f01c415bac418bb8c2dbf9522f439f (DEFAULT_TABLE table=test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:41.720742 32767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.693211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:42735 (local address 127.0.0.1:40178)
0811 18:54:41.712502 (+ 19291us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.712519 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.712633 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.713300 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.713305 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.713334 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:41.713518 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.713528 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.715527 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.715533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.718559 (+ 3026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.718575 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.720056 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.720062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.720240 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.720273 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.720360 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.720483 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19203,"thread_start_us":22106,"threads_started":1}
I20260811 18:54:41.720875 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.693000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.19.155.194:42735)
0811 18:54:41.707962 (+ 14962us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.707977 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.712613 (+ 4636us) server_negotiation.cc:407] Connection header received
0811 18:54:41.712771 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.712783 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.713017 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.713690 (+ 673us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:41.713902 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.715358 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.718772 (+ 3414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.719867 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.720044 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.720209 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.720402 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.720553 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14795,"thread_start_us":14680,"threads_started":1}
I20260811 18:54:41.721092 32641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f01c415bac418bb8c2dbf9522f439f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:41.726500 32414 tablet_service.cc:1467] Processing CreateTablet for tablet 58f01c415bac418bb8c2dbf9522f439f (DEFAULT_TABLE table=test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:41.726500 32195 tablet_service.cc:1467] Processing CreateTablet for tablet 58f01c415bac418bb8c2dbf9522f439f (DEFAULT_TABLE table=test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:41.727888 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f01c415bac418bb8c2dbf9522f439f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:41.727909 32195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58f01c415bac418bb8c2dbf9522f439f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:41.734004 308 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Bootstrap starting.
I20260811 18:54:41.737178 308 tablet_bootstrap.cc:654] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:41.738188 308 log.cc:824] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:41.741034 308 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: No bootstrap required, opened a new log
I20260811 18:54:41.741322 308 ts_tablet_manager.cc:1397] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260811 18:54:41.743619 311 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Bootstrap starting.
I20260811 18:54:41.747207 311 tablet_bootstrap.cc:654] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:41.747573 313 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Bootstrap starting.
I20260811 18:54:41.748615 311 log.cc:824] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:41.750828 313 tablet_bootstrap.cc:654] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:41.751649 311 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: No bootstrap required, opened a new log
I20260811 18:54:41.751353 308 raft_consensus.cc:348] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.751799 308 raft_consensus.cc:374] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:41.751848 313 log.cc:824] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:41.751928 311 ts_tablet_manager.cc:1397] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260811 18:54:41.751909 308 raft_consensus.cc:729] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4556e8caf9e46ad87b8ddf80a2c6705, State: Initialized, Role: FOLLOWER
I20260811 18:54:41.752584 308 consensus_queue.cc:260] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.754369 308 ts_tablet_manager.cc:1428] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260811 18:54:41.754724 32722 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
I20260811 18:54:41.762748 311 raft_consensus.cc:348] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.763214 311 raft_consensus.cc:374] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:41.763320 311 raft_consensus.cc:729] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a83bf9841a42e2beb310f5fde614d0, State: Initialized, Role: FOLLOWER
I20260811 18:54:41.763953 311 consensus_queue.cc:260] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.766681 311 ts_tablet_manager.cc:1428] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Time spent starting tablet: real 0.015s user 0.007s sys 0.006s
I20260811 18:54:41.767028 32517 heartbeater.cc:503] Master 127.19.155.254:46301 was elected leader, sending a full tablet report...
I20260811 18:54:41.767638 313 tablet_bootstrap.cc:492] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: No bootstrap required, opened a new log
I20260811 18:54:41.767935 313 ts_tablet_manager.cc:1397] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.008s
I20260811 18:54:41.775650 313 raft_consensus.cc:348] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.776016 313 raft_consensus.cc:374] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:41.776124 313 raft_consensus.cc:729] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df927cef084e47349faca1a5721b0db4, State: Initialized, Role: FOLLOWER
I20260811 18:54:41.776654 313 consensus_queue.cc:260] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.778267 313 ts_tablet_manager.cc:1428] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260811 18:54:41.812323 322 raft_consensus.cc:482] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:41.812639 322 raft_consensus.cc:504] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.814239 322 leader_election.cc:288] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023), 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:41.822396 301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.814743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:51419 (local address 127.19.155.195:35023)
0811 18:54:41.814998 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.815003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.815584 (+ 581us) server_negotiation.cc:407] Connection header received
0811 18:54:41.815954 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.815963 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.816068 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.816144 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:41.817040 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.818166 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.820304 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.821419 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.821554 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.821608 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.822001 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.822109 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:54:41.822577 324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.814663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:35023 (local address 127.19.155.193:51419)
0811 18:54:41.815482 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.815503 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.815715 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.816379 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.816382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.816406 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:41.816864 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.816878 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.818297 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.818303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.820122 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.820135 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.821637 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.821645 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.821824 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.821860 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.821970 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.822111 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":3,"thread_start_us":461,"threads_started":1}
I20260811 18:54:41.823308 326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.815627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:42735 (local address 127.19.155.193:43723)
0811 18:54:41.816411 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:41.816436 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:41.816548 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:41.816927 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:41.816931 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:41.816958 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:41.817439 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.817452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.819005 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.819009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.820651 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:41.820667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.822303 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.822308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:41.822522 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.822567 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:54:41.822672 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:54:41.822827 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":37,"thread_start_us":500,"threads_started":1}
I20260811 18:54:41.823621 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.815761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:43723 (local address 127.19.155.194:42735)
0811 18:54:41.815963 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.815969 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.816543 (+ 574us) server_negotiation.cc:407] Connection header received
0811 18:54:41.816676 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.816681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.816766 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.816862 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:41.817654 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.818814 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.820868 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.822038 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.822166 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.822265 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.823223 (+ 958us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.823373 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:54:41.823833 32664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58f01c415bac418bb8c2dbf9522f439f" candidate_uuid: "df927cef084e47349faca1a5721b0db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" is_pre_election: true
I20260811 18:54:41.824571 32664 raft_consensus.cc:2454] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df927cef084e47349faca1a5721b0db4 in term 0.
I20260811 18:54:41.824523 32451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58f01c415bac418bb8c2dbf9522f439f" candidate_uuid: "df927cef084e47349faca1a5721b0db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a83bf9841a42e2beb310f5fde614d0" is_pre_election: true
I20260811 18:54:41.825142 32451 raft_consensus.cc:2454] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df927cef084e47349faca1a5721b0db4 in term 0.
I20260811 18:54:41.825405 32136 leader_election.cc:302] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4556e8caf9e46ad87b8ddf80a2c6705, df927cef084e47349faca1a5721b0db4; no voters:
I20260811 18:54:41.825822 322 raft_consensus.cc:2781] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:41.825984 322 raft_consensus.cc:482] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:41.826097 322 raft_consensus.cc:3037] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:41.828296 322 raft_consensus.cc:504] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.828855 322 leader_election.cc:288] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [CANDIDATE]: Term 1 election: Requested vote from peers d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023), 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:41.829303 32664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58f01c415bac418bb8c2dbf9522f439f" candidate_uuid: "df927cef084e47349faca1a5721b0db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705"
I20260811 18:54:41.829376 32451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58f01c415bac418bb8c2dbf9522f439f" candidate_uuid: "df927cef084e47349faca1a5721b0db4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a83bf9841a42e2beb310f5fde614d0"
I20260811 18:54:41.829515 32664 raft_consensus.cc:3037] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:41.829553 32451 raft_consensus.cc:3037] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:41.832940 32451 raft_consensus.cc:2454] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df927cef084e47349faca1a5721b0db4 in term 1.
I20260811 18:54:41.832949 32664 raft_consensus.cc:2454] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df927cef084e47349faca1a5721b0db4 in term 1.
I20260811 18:54:41.833336 32136 leader_election.cc:302] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a83bf9841a42e2beb310f5fde614d0, df927cef084e47349faca1a5721b0db4; no voters:
I20260811 18:54:41.833647 322 raft_consensus.cc:2781] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:41.836081 322 raft_consensus.cc:686] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 1 LEADER]: Becoming Leader. State: Replica: df927cef084e47349faca1a5721b0db4, State: Running, Role: LEADER
I20260811 18:54:41.836782 322 consensus_queue.cc:237] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } }
I20260811 18:54:41.842082 30798 catalog_manager.cc:5495] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 reported cstate change: term changed from 0 to 1, leader changed from <none> to df927cef084e47349faca1a5721b0db4 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "df927cef084e47349faca1a5721b0db4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } health_report { overall_health: UNKNOWN } } }
W20260811 18:54:41.843565 32725 tablet.cc:2369] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:54:41.876343 32304 tablet.cc:2369] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:41.898500 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.893042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52636 (local address 127.19.155.193:36435)
0811 18:54:41.893321 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.893326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.893345 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:41.893493 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.893497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.893580 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.893710 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:41.894045 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.894782 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.896270 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.896734 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.896872 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:41.897294 (+ 422us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:41.897887 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:41.898001 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:41.898098 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:54:41.898174 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:54:41.907205 32451 raft_consensus.cc:1261] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Refusing update from remote peer df927cef084e47349faca1a5721b0db4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:41.907341 32664 raft_consensus.cc:1261] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Refusing update from remote peer df927cef084e47349faca1a5721b0db4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:41.908282 327 consensus_queue.cc:1035] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:41.908643 322 consensus_queue.cc:1035] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:41.959088 30798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:41.959398 30798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:41.965777 30798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1dfb2305c362492c85f5a95b5a32fc1b: Sending DeleteTablet for 3 replicas of tablet 58f01c415bac418bb8c2dbf9522f439f
I20260811 18:54:41.967428 32641 tablet_service.cc:1514] Processing DeleteTablet for tablet 58f01c415bac418bb8c2dbf9522f439f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:41 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:34436
I20260811 18:54:41.967507 32195 tablet_service.cc:1514] Processing DeleteTablet for tablet 58f01c415bac418bb8c2dbf9522f439f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:41 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:52628
I20260811 18:54:41.968518 344 tablet_replica.cc:330] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: stopping tablet replica
I20260811 18:54:41.968891 345 tablet_replica.cc:330] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: stopping tablet replica
I20260811 18:54:41.969105 344 raft_consensus.cc:2229] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:41.969288 345 raft_consensus.cc:2229] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:41.969771 344 raft_consensus.cc:2258] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:41.970003 345 raft_consensus.cc:2258] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:41.971958 344 ts_tablet_manager.cc:1905] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:41.972736 345 ts_tablet_manager.cc:1905] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:41.974531 32414 tablet_service.cc:1514] Processing DeleteTablet for tablet 58f01c415bac418bb8c2dbf9522f439f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:41 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:40178
I20260811 18:54:41.979367 346 tablet_replica.cc:330] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: stopping tablet replica
I20260811 18:54:41.979786 346 raft_consensus.cc:2229] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:41.979956 344 ts_tablet_manager.cc:1918] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:41.980221 344 log.cc:1196] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/58f01c415bac418bb8c2dbf9522f439f
I20260811 18:54:41.980340 346 raft_consensus.cc:2258] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:41.980962 344 ts_tablet_manager.cc:1939] T 58f01c415bac418bb8c2dbf9522f439f P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting consensus metadata
I20260811 18:54:41.981803 345 ts_tablet_manager.cc:1918] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:41.982017 345 log.cc:1196] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/58f01c415bac418bb8c2dbf9522f439f
I20260811 18:54:41.982649 345 ts_tablet_manager.cc:1939] T 58f01c415bac418bb8c2dbf9522f439f P df927cef084e47349faca1a5721b0db4: Deleting consensus metadata
I20260811 18:54:41.983098 30774 catalog_manager.cc:4841] TS d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023): tablet 58f01c415bac418bb8c2dbf9522f439f (table test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]) successfully deleted
I20260811 18:54:41.984251 30774 catalog_manager.cc:4841] TS df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435): tablet 58f01c415bac418bb8c2dbf9522f439f (table test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]) successfully deleted
I20260811 18:54:41.988373 346 ts_tablet_manager.cc:1905] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:41.988610 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 30744
I20260811 18:54:41.989710 30853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:41.998589 346 ts_tablet_manager.cc:1918] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:41.998803 346 log.cc:1196] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/58f01c415bac418bb8c2dbf9522f439f
I20260811 18:54:41.999461 346 ts_tablet_manager.cc:1939] T 58f01c415bac418bb8c2dbf9522f439f P 82a83bf9841a42e2beb310f5fde614d0: Deleting consensus metadata
I20260811 18:54:42.011624 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.977903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.19.155.253:44689)
0811 18:54:41.978086 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.978092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:41.984751 (+ 6659us) server_negotiation.cc:407] Connection header received
0811 18:54:41.984968 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:41.984975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:41.985051 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:41.985160 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:41.986787 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.987968 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.993853 (+ 5885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:41.994521 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:41.994673 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:42.004845 (+ 10172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:42.004859 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:42.004862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:42.004900 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:42.008137 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.009075 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.009084 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.009090 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.009289 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.009745 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.009760 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.009763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.010171 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:42.010436 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:42.011002 (+ 566us) server_negotiation.cc:299] Negotiation successful
0811 18:54:42.011266 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:54:42.028945 32729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:41.987952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49030 (local address 127.19.155.252:36915)
0811 18:54:41.988253 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:41.988260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:42.011855 (+ 23595us) server_negotiation.cc:407] Connection header received
0811 18:54:42.012102 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:42.012109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:42.012218 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:42.012305 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:42.014425 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.015639 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.017692 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.018446 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.018579 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:42.022069 (+ 3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:42.022076 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:42.022081 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:42.022121 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:42.025996 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.026760 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.026766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.026770 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.026958 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.027384 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.027389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.027393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.027739 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:42.028014 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:42.028338 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:54:42.028557 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260811 18:54:42.121274 30774 catalog_manager.cc:4841] TS 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735): tablet 58f01c415bac418bb8c2dbf9522f439f (table test-table [id=62fa76f2bde545efb5e2301c5ac0c7c4]) successfully deleted
I20260811 18:54:42.121987 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 30744
I20260811 18:54:42.187731 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:42.168801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.19.155.253:44689)
0811 18:54:42.169063 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:42.169071 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:42.169597 (+ 526us) server_negotiation.cc:407] Connection header received
0811 18:54:42.169848 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:42.169855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:42.169943 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:42.170050 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:42.172405 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.173542 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.175917 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.176566 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.176666 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:42.180553 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:42.180560 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:42.180565 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:42.180604 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:42.184343 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.185189 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.185194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.185198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.185363 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.185851 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.185856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.185860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.186267 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:42.186514 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:42.187146 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 18:54:42.187383 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:54:42.190073 32729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:42.167506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49032 (local address 127.19.155.252:36915)
0811 18:54:42.167803 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:42.167813 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:42.168798 (+ 985us) server_negotiation.cc:407] Connection header received
0811 18:54:42.170040 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:42.170049 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:42.170158 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:42.170249 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:42.173147 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.174609 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.177257 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:42.179681 (+ 2424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:42.179788 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:42.183272 (+ 3484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:42.183279 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:42.183284 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:42.183321 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:42.186747 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.187577 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.187582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.187585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.187721 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:42.188411 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:42.188416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:42.188420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:42.188778 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:42.189003 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:42.189538 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 18:54:42.189758 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:54:42.950022 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:42.949200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:36657)
0811 18:54:42.949706 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:42.949850 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":257,"threads_started":1}
W20260811 18:54:42.950512 32722 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46301 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:42.952994 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:42.952277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:32957)
0811 18:54:42.952737 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:42.952851 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":251,"threads_started":1}
W20260811 18:54:42.953367 32302 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46301 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:42.955348 362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:42.954416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:57627)
0811 18:54:42.954891 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:42.955048 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":225,"threads_started":1}
W20260811 18:54:42.955703 32517 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46301 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:43.466369 363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1dfb2305c362492c85f5a95b5a32fc1b)
I20260811 18:54:43.466747 363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } }
I20260811 18:54:43.467072 364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1dfb2305c362492c85f5a95b5a32fc1b)
I20260811 18:54:43.467350 364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } }
I20260811 18:54:43.468320 363 leader_election.cc:288] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301), 356b6d3abaff42dca171dd630b8f191d (127.19.155.253:44689)
I20260811 18:54:43.469569 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.468543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55424)
0811 18:54:43.469016 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.469212 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":241,"threads_started":1}
I20260811 18:54:43.470235 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.468638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55440)
0811 18:54:43.469689 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.469924 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":766,"threads_started":1}
I20260811 18:54:43.470634 364 leader_election.cc:288] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301), 54707dd735ea47e48e1032810d7f0c98 (127.19.155.252:36915)
W20260811 18:54:43.470762 31999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
W20260811 18:54:43.471839 31731 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:43.473066 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.472242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55450)
0811 18:54:43.472517 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.472848 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260811 18:54:43.473259 31999 leader_election.cc:334] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301): Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:43.479004 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.469313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:44689 (local address 127.0.0.1:42558)
0811 18:54:43.469899 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.469919 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.470065 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.472330 (+ 2265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.472335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.472373 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.472683 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.472701 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.474616 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.474622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.476612 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.476628 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.478134 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.478140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.478359 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.478409 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.478522 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.478668 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":1075,"threads_started":1}
I20260811 18:54:43.479231 375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.474526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55456)
0811 18:54:43.478720 (+ 4194us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.478922 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4048,"thread_start_us":3904,"threads_started":1}
W20260811 18:54:43.479627 31731 leader_election.cc:334] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301): Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:43.479972 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.469721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42558 (local address 127.19.155.253:44689)
0811 18:54:43.471900 (+ 2179us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.471909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.471929 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:43.471995 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.472001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.472182 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.472310 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.472973 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.474456 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.476838 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.477963 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.478134 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.478207 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.479423 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.479541 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2026,"thread_start_us":1830,"threads_started":1}
I20260811 18:54:43.480681 31764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54707dd735ea47e48e1032810d7f0c98" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "356b6d3abaff42dca171dd630b8f191d" is_pre_election: true
I20260811 18:54:43.481045 31764 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54707dd735ea47e48e1032810d7f0c98 in term 1.
I20260811 18:54:43.481298 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.470806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:36915 (local address 127.0.0.1:49048)
0811 18:54:43.471220 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.471239 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.471370 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.473705 (+ 2335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.473710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.473735 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.474020 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.474029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.475930 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.475939 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.478785 (+ 2846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.478799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.480511 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.480517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.480725 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.480781 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.480921 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.481069 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":49}
I20260811 18:54:43.481438 372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.471407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.19.155.252:36915)
0811 18:54:43.473406 (+ 1999us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.473414 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.473438 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:54:43.473498 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.473503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.473567 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.473667 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.474183 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.475720 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.479013 (+ 3293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.480269 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.480440 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.480511 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.480962 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.481085 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1849,"thread_start_us":1656,"threads_started":1}
I20260811 18:54:43.481711 31999 leader_election.cc:302] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356b6d3abaff42dca171dd630b8f191d, 54707dd735ea47e48e1032810d7f0c98; no voters: 1dfb2305c362492c85f5a95b5a32fc1b
I20260811 18:54:43.482007 32044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "356b6d3abaff42dca171dd630b8f191d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "54707dd735ea47e48e1032810d7f0c98" is_pre_election: true
I20260811 18:54:43.482092 363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:54:43.482254 363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1dfb2305c362492c85f5a95b5a32fc1b)
I20260811 18:54:43.482386 363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:54:43.484578 363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } }
I20260811 18:54:43.485020 32044 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 356b6d3abaff42dca171dd630b8f191d in current term 2: Already voted for candidate 54707dd735ea47e48e1032810d7f0c98 in this term.
I20260811 18:54:43.485260 363 leader_election.cc:288] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 election: Requested vote from peers 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301), 356b6d3abaff42dca171dd630b8f191d (127.19.155.253:44689)
I20260811 18:54:43.485924 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.485357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55482)
0811 18:54:43.485649 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.485794 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260811 18:54:43.485891 31764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54707dd735ea47e48e1032810d7f0c98" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "356b6d3abaff42dca171dd630b8f191d"
I20260811 18:54:43.486093 31764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:54:43.486044 31730 leader_election.cc:302] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 356b6d3abaff42dca171dd630b8f191d; no voters: 1dfb2305c362492c85f5a95b5a32fc1b, 54707dd735ea47e48e1032810d7f0c98
I20260811 18:54:43.487035 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.486617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55484)
0811 18:54:43.486783 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.486883 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:54:43.487198 31999 leader_election.cc:334] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301): Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
I20260811 18:54:43.488590 31764 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54707dd735ea47e48e1032810d7f0c98 in term 2.
I20260811 18:54:43.488761 364 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:54:43.489046 31999 leader_election.cc:302] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 356b6d3abaff42dca171dd630b8f191d, 54707dd735ea47e48e1032810d7f0c98; no voters: 1dfb2305c362492c85f5a95b5a32fc1b
I20260811 18:54:43.489362 363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:54:43.489851 363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [term 2 LEADER]: Becoming Leader. State: Replica: 54707dd735ea47e48e1032810d7f0c98, State: Running, Role: LEADER
I20260811 18:54:43.490231 363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } }
I20260811 18:54:43.491978 376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54707dd735ea47e48e1032810d7f0c98. Latest consensus state: current_term: 2 leader_uuid: "54707dd735ea47e48e1032810d7f0c98" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:43.492311 376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:43.492961 379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:43.496600 379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:43.497412 379 catalog_manager.cc:1259] Loaded cluster ID: e52cc51de3d045e8ba6121d338183009
I20260811 18:54:43.497516 379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:43.498653 379 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:43.499595 379 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Loaded TSK: 0
I20260811 18:54:43.500494 379 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:54:43.534173 32023 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49032:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:43.541267 32023 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:43.545380 31764 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [term 2 FOLLOWER]: Refusing update from remote peer 54707dd735ea47e48e1032810d7f0c98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 18:54:43.545437 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.544942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55512)
0811 18:54:43.545131 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.545261 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 18:54:43.546233 376 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 18:54:43.546643 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.546259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55518)
0811 18:54:43.546421 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.546512 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:54:43.546952 31999 consensus_peers.cc:487] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 -> Peer 1dfb2305c362492c85f5a95b5a32fc1b (127.19.155.254:46301): Couldn't send request to peer 1dfb2305c362492c85f5a95b5a32fc1b. Status: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:54:43.549016 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54707dd735ea47e48e1032810d7f0c98. Latest consensus state: current_term: 2 leader_uuid: "54707dd735ea47e48e1032810d7f0c98" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:43.549248 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:43.550879 376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "54707dd735ea47e48e1032810d7f0c98" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:43.551196 376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:43.551788 364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "54707dd735ea47e48e1032810d7f0c98" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "1dfb2305c362492c85f5a95b5a32fc1b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46301 } } peers { permanent_uuid: "356b6d3abaff42dca171dd630b8f191d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 44689 } attrs { promote: false } } peers { permanent_uuid: "54707dd735ea47e48e1032810d7f0c98" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 36915 } attrs { promote: false } } }
I20260811 18:54:43.552102 364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 356b6d3abaff42dca171dd630b8f191d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:54:43.579216 391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.560305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:35023 (local address 127.0.0.1:34444)
0811 18:54:43.572468 (+ 12163us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.572484 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.572670 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.573264 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.573267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.573287 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.573585 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.573593 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.574654 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.574662 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.576614 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.576628 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.578225 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.578229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.578475 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.578510 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.578593 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.578714 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12039,"mutex_wait_us":41,"thread_start_us":11898,"threads_started":1}
I20260811 18:54:43.579627 392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.560434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.19.155.195:35023)
0811 18:54:43.571900 (+ 11466us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.571910 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.572570 (+ 660us) server_negotiation.cc:407] Connection header received
0811 18:54:43.572841 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.572847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.572948 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.573023 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.573777 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.574517 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.576886 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.577908 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.578010 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.578060 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.578995 (+ 935us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.579149 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11299,"thread_start_us":11473,"threads_started":1}
I20260811 18:54:43.580336 32641 tablet_service.cc:1467] Processing CreateTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 (DEFAULT_TABLE table=test-table [id=fc349672e8824b64a208fca779973bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:43.580816 32641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b66aa54a4b7456d97899f855f33a9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:43.581318 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.559517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36435 (local address 127.0.0.1:52642)
0811 18:54:43.559724 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.559744 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.559859 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.575460 (+ 15601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.575465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.575491 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.575678 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.575689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.577034 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.577040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.578942 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.578961 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.580713 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.580720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.580912 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.580944 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.581013 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.581126 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":58}
I20260811 18:54:43.582037 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.559640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52642 (local address 127.19.155.193:36435)
0811 18:54:43.575042 (+ 15402us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.575052 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.575077 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:54:43.575164 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.575171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.575269 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.575393 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.575834 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.576866 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.579147 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.580501 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.581578 (+ 1077us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.581657 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.581717 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.581832 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15209,"thread_start_us":15914,"threads_started":1}
I20260811 18:54:43.582970 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.559851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:42735 (local address 127.0.0.1:40190)
0811 18:54:43.560311 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.560333 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.560471 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.576936 (+ 16465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.576940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.576968 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.577324 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.577339 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.578738 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.578743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.580659 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.580678 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.582277 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.582283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.582439 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.582472 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.582533 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.582662 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":25}
I20260811 18:54:43.583756 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.560765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.19.155.194:42735)
0811 18:54:43.576509 (+ 15744us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.576516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.576534 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:54:43.576600 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.576605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.576670 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.576917 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.577496 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.578578 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.580879 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.582054 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.583225 (+ 1171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.583295 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.583341 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.583468 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15620,"thread_start_us":15954,"threads_started":1}
I20260811 18:54:43.584585 32414 tablet_service.cc:1467] Processing CreateTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 (DEFAULT_TABLE table=test-table [id=fc349672e8824b64a208fca779973bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:43.585044 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b66aa54a4b7456d97899f855f33a9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:43.587615 32195 tablet_service.cc:1467] Processing CreateTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 (DEFAULT_TABLE table=test-table [id=fc349672e8824b64a208fca779973bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:43.587790 396 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Bootstrap starting.
I20260811 18:54:43.588063 32195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b66aa54a4b7456d97899f855f33a9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:43.589634 396 tablet_bootstrap.cc:654] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:43.596987 398 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Bootstrap starting.
I20260811 18:54:43.598649 398 tablet_bootstrap.cc:654] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:43.601078 396 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: No bootstrap required, opened a new log
I20260811 18:54:43.601349 396 ts_tablet_manager.cc:1397] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260811 18:54:43.602526 396 raft_consensus.cc:348] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.603025 396 raft_consensus.cc:374] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:43.603227 396 raft_consensus.cc:729] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4556e8caf9e46ad87b8ddf80a2c6705, State: Initialized, Role: FOLLOWER
I20260811 18:54:43.603694 396 consensus_queue.cc:260] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.607661 398 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: No bootstrap required, opened a new log
I20260811 18:54:43.607824 398 ts_tablet_manager.cc:1397] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260811 18:54:43.608218 400 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Bootstrap starting.
I20260811 18:54:43.608640 398 raft_consensus.cc:348] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.608875 398 raft_consensus.cc:374] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:43.608996 398 raft_consensus.cc:729] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a83bf9841a42e2beb310f5fde614d0, State: Initialized, Role: FOLLOWER
I20260811 18:54:43.609169 396 ts_tablet_manager.cc:1428] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20260811 18:54:43.609305 398 consensus_queue.cc:260] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.612008 32721 heartbeater.cc:503] Master 127.19.155.252:36915 was elected leader, sending a full tablet report...
I20260811 18:54:43.612327 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.611102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:49127)
0811 18:54:43.611779 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.611961 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"threads_started":1}
I20260811 18:54:43.613590 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.613159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:58063)
0811 18:54:43.613367 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.613454 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 18:54:43.613900 400 tablet_bootstrap.cc:654] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:43.615857 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.610421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:53747)
0811 18:54:43.615429 (+ 5008us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.615620 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4887,"thread_start_us":4729,"threads_started":1}
I20260811 18:54:43.616271 400 tablet_bootstrap.cc:492] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: No bootstrap required, opened a new log
I20260811 18:54:43.616317 398 ts_tablet_manager.cc:1428] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 18:54:43.616437 400 ts_tablet_manager.cc:1397] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20260811 18:54:43.616604 32515 heartbeater.cc:503] Master 127.19.155.252:36915 was elected leader, sending a full tablet report...
I20260811 18:54:43.617522 400 raft_consensus.cc:348] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.617796 400 raft_consensus.cc:374] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:43.617902 400 raft_consensus.cc:729] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df927cef084e47349faca1a5721b0db4, State: Initialized, Role: FOLLOWER
I20260811 18:54:43.618384 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.617513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:43655)
0811 18:54:43.617722 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.617828 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260811 18:54:43.618221 400 consensus_queue.cc:260] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.619805 400 ts_tablet_manager.cc:1428] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 18:54:43.620955 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.620005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:47147)
0811 18:54:43.620564 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.620707 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":303,"threads_started":1}
I20260811 18:54:43.621682 32300 heartbeater.cc:503] Master 127.19.155.252:36915 was elected leader, sending a full tablet report...
I20260811 18:54:43.622313 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.621789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:59987)
0811 18:54:43.622081 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.622155 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
I20260811 18:54:43.640115 403 raft_consensus.cc:482] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:43.640329 403 raft_consensus.cc:504] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.641845 403 leader_election.cc:288] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435), 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:43.648764 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.642120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:34453 (local address 127.19.155.193:36435)
0811 18:54:43.642336 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.642343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.642364 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:54:43.642547 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.642555 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.642650 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.642770 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.643399 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.644365 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.646783 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.647979 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.648148 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.648223 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.648453 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.648574 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:54:43.648892 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.642007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36435 (local address 127.19.155.195:34453)
0811 18:54:43.642233 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.642250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.642388 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.642855 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.642860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.642931 (+ 71us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.643256 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.643270 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.644490 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.644493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.646605 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.646620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.648175 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.648180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.648295 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.648320 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.648396 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.648558 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":24}
I20260811 18:54:43.649408 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.642385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:42735 (local address 127.19.155.195:51385)
0811 18:54:43.643058 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.643073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:43.643214 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:43.643572 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:43.643575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:43.643594 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:43.643814 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.643820 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.644921 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.644940 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.646982 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:43.646996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.648531 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.648536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:43.648716 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.648747 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:54:43.648871 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 18:54:43.649012 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":22,"thread_start_us":339,"threads_started":1}
I20260811 18:54:43.649565 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.642518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:51385 (local address 127.19.155.194:42735)
0811 18:54:43.642746 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.642754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.643161 (+ 407us) server_negotiation.cc:407] Connection header received
0811 18:54:43.643375 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.643380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.643455 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.643551 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:43.643953 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.644784 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.647143 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.648336 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.648500 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.648563 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.649141 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.649288 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:54:43.649765 32226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b66aa54a4b7456d97899f855f33a9b6" candidate_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df927cef084e47349faca1a5721b0db4" is_pre_election: true
I20260811 18:54:43.650141 32226 raft_consensus.cc:2454] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4556e8caf9e46ad87b8ddf80a2c6705 in term 0.
I20260811 18:54:43.650142 32451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b66aa54a4b7456d97899f855f33a9b6" candidate_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a83bf9841a42e2beb310f5fde614d0" is_pre_election: true
I20260811 18:54:43.650363 32451 raft_consensus.cc:2454] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4556e8caf9e46ad87b8ddf80a2c6705 in term 0.
I20260811 18:54:43.650785 32559 leader_election.cc:302] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4556e8caf9e46ad87b8ddf80a2c6705, df927cef084e47349faca1a5721b0db4; no voters:
I20260811 18:54:43.651160 403 raft_consensus.cc:2781] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:43.651300 403 raft_consensus.cc:482] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:43.651422 403 raft_consensus.cc:3037] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:43.653555 403 raft_consensus.cc:504] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.654095 403 leader_election.cc:288] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [CANDIDATE]: Term 1 election: Requested vote from peers df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435), 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735)
I20260811 18:54:43.654531 32226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b66aa54a4b7456d97899f855f33a9b6" candidate_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df927cef084e47349faca1a5721b0db4"
I20260811 18:54:43.654646 32451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b66aa54a4b7456d97899f855f33a9b6" candidate_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a83bf9841a42e2beb310f5fde614d0"
I20260811 18:54:43.654727 32226 raft_consensus.cc:3037] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:43.654841 32451 raft_consensus.cc:3037] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:43.656906 32226 raft_consensus.cc:2454] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4556e8caf9e46ad87b8ddf80a2c6705 in term 1.
I20260811 18:54:43.657032 32451 raft_consensus.cc:2454] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4556e8caf9e46ad87b8ddf80a2c6705 in term 1.
I20260811 18:54:43.657349 32559 leader_election.cc:302] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4556e8caf9e46ad87b8ddf80a2c6705, df927cef084e47349faca1a5721b0db4; no voters:
I20260811 18:54:43.657636 403 raft_consensus.cc:2781] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:43.658098 403 raft_consensus.cc:686] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 LEADER]: Becoming Leader. State: Replica: d4556e8caf9e46ad87b8ddf80a2c6705, State: Running, Role: LEADER
I20260811 18:54:43.658493 403 consensus_queue.cc:237] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } }
I20260811 18:54:43.659057 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.658633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:39629)
0811 18:54:43.658786 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.658891 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 18:54:43.661811 32023 catalog_manager.cc:5495] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4556e8caf9e46ad87b8ddf80a2c6705" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35023 } health_report { overall_health: HEALTHY } } }
I20260811 18:54:43.703553 392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.697575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34452 (local address 127.19.155.195:35023)
0811 18:54:43.697798 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.697804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.697824 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:43.698053 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.698062 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.698148 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.698325 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:43.698719 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.699494 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.701348 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.701762 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.701898 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.702381 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:43.702987 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:43.703141 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.703206 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.703289 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:54:43.707845 32451 raft_consensus.cc:1261] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Refusing update from remote peer d4556e8caf9e46ad87b8ddf80a2c6705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:43.708223 32226 raft_consensus.cc:1261] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Refusing update from remote peer d4556e8caf9e46ad87b8ddf80a2c6705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:43.708587 415 consensus_queue.cc:1035] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a83bf9841a42e2beb310f5fde614d0" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 42735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:43.709018 403 consensus_queue.cc:1035] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df927cef084e47349faca1a5721b0db4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:43.711431 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.710897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:58017)
0811 18:54:43.711093 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.711217 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 18:54:43.711567 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.711161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:50977)
0811 18:54:43.711298 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.711399 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:54:43.718173 420 mvcc.cc:205] Tried to move back new op lower bound from 7317399485259759616 to 7317399485069492224. Current Snapshot: MvccSnapshot[applied={T|T < 7317399485259759616}]
I20260811 18:54:43.719805 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.719373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:53107)
0811 18:54:43.719536 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.719626 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 18:54:43.719818 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.719405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.194:51561)
0811 18:54:43.719592 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.719660 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 18:54:43.724224 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.723740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.195:59411)
0811 18:54:43.723926 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.724069 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:54:43.727197 410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.726659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.19.155.193:58869)
0811 18:54:43.726946 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:43.727033 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260811 18:54:43.732033 32024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:43.732339 32024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49032:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:43.737965 32024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54707dd735ea47e48e1032810d7f0c98: Sending DeleteTablet for 3 replicas of tablet 1b66aa54a4b7456d97899f855f33a9b6
I20260811 18:54:43.739300 32641 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:43 UTC) from {username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:34444
I20260811 18:54:43.739344 32414 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:43 UTC) from {username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:40190
I20260811 18:54:43.739353 32195 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b66aa54a4b7456d97899f855f33a9b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:43 UTC) from {username='oryx', principal='oryx/127.19.155.252@KRBTEST.COM'} at 127.0.0.1:52642
I20260811 18:54:43.741355 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 31985
I20260811 18:54:43.754376 433 tablet_replica.cc:330] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: stopping tablet replica
I20260811 18:54:43.754609 433 raft_consensus.cc:2229] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:43.755445 431 tablet_replica.cc:330] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: stopping tablet replica
I20260811 18:54:43.755708 431 raft_consensus.cc:2229] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:43.754979 433 raft_consensus.cc:2258] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:43.756497 431 raft_consensus.cc:2258] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:43.757589 431 ts_tablet_manager.cc:1905] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:43.758072 433 ts_tablet_manager.cc:1905] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:43.763373 432 tablet_replica.cc:330] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: stopping tablet replica
I20260811 18:54:43.763777 433 ts_tablet_manager.cc:1918] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:43.763823 431 ts_tablet_manager.cc:1918] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:43.763937 433 log.cc:1196] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/1b66aa54a4b7456d97899f855f33a9b6
I20260811 18:54:43.763963 431 log.cc:1196] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/1b66aa54a4b7456d97899f855f33a9b6
I20260811 18:54:43.764456 433 ts_tablet_manager.cc:1939] T 1b66aa54a4b7456d97899f855f33a9b6 P df927cef084e47349faca1a5721b0db4: Deleting consensus metadata
I20260811 18:54:43.764487 431 ts_tablet_manager.cc:1939] T 1b66aa54a4b7456d97899f855f33a9b6 P d4556e8caf9e46ad87b8ddf80a2c6705: Deleting consensus metadata
I20260811 18:54:43.764494 432 raft_consensus.cc:2229] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:43.764813 432 raft_consensus.cc:2258] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:43.765859 32000 catalog_manager.cc:4841] TS df927cef084e47349faca1a5721b0db4 (127.19.155.193:36435): tablet 1b66aa54a4b7456d97899f855f33a9b6 (table test-table [id=fc349672e8824b64a208fca779973bb2]) successfully deleted
I20260811 18:54:43.765985 432 ts_tablet_manager.cc:1905] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:43.767673 32000 catalog_manager.cc:4841] TS d4556e8caf9e46ad87b8ddf80a2c6705 (127.19.155.195:35023): tablet 1b66aa54a4b7456d97899f855f33a9b6 (table test-table [id=fc349672e8824b64a208fca779973bb2]) successfully deleted
I20260811 18:54:43.772755 432 ts_tablet_manager.cc:1918] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:43.772918 432 log.cc:1196] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/1b66aa54a4b7456d97899f855f33a9b6
I20260811 18:54:43.773384 432 ts_tablet_manager.cc:1939] T 1b66aa54a4b7456d97899f855f33a9b6 P 82a83bf9841a42e2beb310f5fde614d0: Deleting consensus metadata
I20260811 18:54:43.773748 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.742185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.19.155.193:36435)
0811 18:54:43.742533 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.742543 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.757297 (+ 14754us) server_negotiation.cc:407] Connection header received
0811 18:54:43.757507 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.757513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.757606 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.757739 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:43.759748 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.760853 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.762702 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.763374 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.763524 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.767277 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:43.767294 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:43.767316 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:43.767357 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:43.770686 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:43.771445 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:43.771453 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:43.771455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:43.771583 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:43.771977 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:43.771986 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:43.771989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:43.772354 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:43.772652 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.773086 (+ 434us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.773315 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260811 18:54:43.774439 32293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:43.774518 32000 catalog_manager.cc:4841] TS 82a83bf9841a42e2beb310f5fde614d0 (127.19.155.194:42735): tablet 1b66aa54a4b7456d97899f855f33a9b6 (table test-table [id=fc349672e8824b64a208fca779973bb2]) successfully deleted
I20260811 18:54:43.896500 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 31985
I20260811 18:54:43.935184 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 32318
I20260811 18:54:43.949153 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:43.935993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.19.155.194:42735)
0811 18:54:43.936196 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:43.936210 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:43.936319 (+ 109us) server_negotiation.cc:407] Connection header received
0811 18:54:43.936498 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:43.936502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:43.936596 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:43.936713 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:43.938086 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.938809 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.940063 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:43.940459 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:43.940594 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:43.943264 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:43.943279 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:43.943295 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:43.943328 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:43.946206 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:43.946932 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:43.946945 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:43.946949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:43.947136 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:43.947541 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:43.947548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:43.947551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:43.947922 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:43.948261 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:43.948591 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 18:54:43.948810 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:54:43.949851 32506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:44.076416 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:44.075723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55526)
0811 18:54:44.076065 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:44.076204 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260811 18:54:44.092577 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:44.092034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46301 (local address 127.0.0.1:55530)
0811 18:54:44.092253 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:44.092370 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:54:44.111621 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 32318
I20260811 18:54:44.151795 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 32532
I20260811 18:54:44.172644 392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:44.153076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34466 (local address 127.19.155.195:35023)
0811 18:54:44.153288 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:44.153296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:44.153332 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:54:44.153404 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:44.153410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:44.153541 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:44.153670 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:44.156001 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:44.157189 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:44.159314 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:44.159991 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:44.160154 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:44.164336 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:44.164353 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:44.164374 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:44.164418 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:44.168752 (+ 4334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:44.169743 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:44.169753 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:44.169756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:44.169953 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:44.170484 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:44.170489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:44.170493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:44.171024 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:44.171390 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:44.171770 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 18:54:44.172017 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 18:54:44.173534 32716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:44.314016 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 32532
I20260811 18:54:44.346040 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 31535
I20260811 18:54:44.347244 31794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:44.464201 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 31535
I20260811 18:54:44.496740 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 31696
I20260811 18:54:44.497844 32072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:44.618674 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 31696
2026-08-11T18:54:44Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9926 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:44 dist-test-slave-1nl6 krb5kdc[451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:44 dist-test-slave-1nl6 krb5kdc[451](info): set up 2 sockets
Aug 11 18:54:44 dist-test-slave-1nl6 krb5kdc[451](info): commencing operation
krb5kdc: starting...
W20260811 18:54:45.942643 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:46 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab.
Entry for principal oryx/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab.
I20260811 18:54:46.192715 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34369
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab
--principal=oryx/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:46.519007 473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:46.519327 473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:46.519493 473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:46.526400 473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:46.526531 473 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:54:46.526629 473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:46.526746 473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:46.526844 473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:46.526964 473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:46.536543 473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34369
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.254.keytab
--principal=oryx/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:46.537717 473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:46.538992 473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:46.550956 483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:46.550993 482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:46.551023 487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:46.551666 473 server_base.cc:1034] running on GCE node
I20260811 18:54:46.552421 473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:46.553730 473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:46.555027 473 hybrid_clock.cc:648] HybridClock initialized: now 1786474486554964 us; error 33 us; skew 500 ppm
I20260811 18:54:46.555382 473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:46 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474486, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:46.558430 473 init.cc:377] Logged in from keytab as oryx/127.19.155.254@KRBTEST.COM (short username oryx)
I20260811 18:54:46.559821 473 webserver.cc:460] Webserver started at http://127.19.155.254:34617/ using document root <none> and password file <none>
I20260811 18:54:46.560426 473 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:46.560508 473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:46.560758 473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:46.563561 473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "8d6862f5186d4cabaed2747a0a513734"
format_stamp: "Formatted at 2026-08-11 18:54:46 on dist-test-slave-1nl6"
server_key: "ec5ee353468f8392c818fbb799ff12b2"
server_key_iv: "c9c99b479f3b5628e57a0a0643032513"
server_key_version: "encryptionkey@0"
I20260811 18:54:46.564265 473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "8d6862f5186d4cabaed2747a0a513734"
format_stamp: "Formatted at 2026-08-11 18:54:46 on dist-test-slave-1nl6"
server_key: "ec5ee353468f8392c818fbb799ff12b2"
server_key_iv: "c9c99b479f3b5628e57a0a0643032513"
server_key_version: "encryptionkey@0"
I20260811 18:54:46.569056 473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:54:46.572314 495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:46.573527 473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:54:46.573726 473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "8d6862f5186d4cabaed2747a0a513734"
format_stamp: "Formatted at 2026-08-11 18:54:46 on dist-test-slave-1nl6"
server_key: "ec5ee353468f8392c818fbb799ff12b2"
server_key_iv: "c9c99b479f3b5628e57a0a0643032513"
server_key_version: "encryptionkey@0"
I20260811 18:54:46.573938 473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:46.594282 473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:46.598121 473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:46.598428 473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:46.620069 473 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34369
I20260811 18:54:46.620091 586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34369 every 8 connection(s)
I20260811 18:54:46.621483 473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:46.624838 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 473
I20260811 18:54:46.625046 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:46.625656 587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:46.625974 20079 external_mini_cluster.cc:1428] Setting key c674c9796ca5a9b8e232d19db3d53898
I20260811 18:54:46.639375 587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Bootstrap starting.
I20260811 18:54:46.642923 587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Neither blocks nor log segments found. Creating new log.
Aug 11 18:54:46 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:46.643996 587 log.cc:824] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:46.646692 587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: No bootstrap required, opened a new log
I20260811 18:54:46.651759 592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:46.628003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.19.155.254:34369)
0811 18:54:46.628809 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:46.628820 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:46.628865 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:54:46.630551 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:46.630572 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:46.630988 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:46.631320 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:46.633089 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:46.634344 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:46.636107 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:46.636788 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:46.636943 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:46.644547 (+ 7604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:46.644555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:46.644569 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:46.644609 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:46.647794 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:46.648523 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:46.648529 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:46.648535 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:46.648693 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:46.649141 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:46.649145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:46.649147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:46.649614 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:46.649971 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:46.650341 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 18:54:46.650740 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":365,"threads_started":1}
I20260811 18:54:46.654210 587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } }
I20260811 18:54:46.654630 587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:46.654703 587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6862f5186d4cabaed2747a0a513734, State: Initialized, Role: FOLLOWER
I20260811 18:54:46.655207 587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } }
I20260811 18:54:46.655421 587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:46.655514 587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:46.655630 587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:46.657599 587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } }
I20260811 18:54:46.658140 587 leader_election.cc:302] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d6862f5186d4cabaed2747a0a513734; no voters:
I20260811 18:54:46.658857 587 leader_election.cc:288] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:46.658993 594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:46.659762 594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [term 1 LEADER]: Becoming Leader. State: Replica: 8d6862f5186d4cabaed2747a0a513734, State: Running, Role: LEADER
I20260811 18:54:46.660300 594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } }
I20260811 18:54:46.660861 587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:46.663372 601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d6862f5186d4cabaed2747a0a513734. Latest consensus state: current_term: 1 leader_uuid: "8d6862f5186d4cabaed2747a0a513734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } } }
I20260811 18:54:46.663812 601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:46.663688 599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d6862f5186d4cabaed2747a0a513734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6862f5186d4cabaed2747a0a513734" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34369 } } }
I20260811 18:54:46.663995 599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:46.666164 606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:46.671304 606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:46.680166 606 catalog_manager.cc:1347] Generated new cluster ID: ef9b14aff84442738d7e48fbee067327
I20260811 18:54:46.680276 606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:46.690294 606 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:46.691618 606 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:46.700519 606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Generated new TSK 0
I20260811 18:54:46.701201 606 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
I20260811 18:54:46.762243 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34369
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:47.089970 630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:47.090287 630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:47.090461 630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:47.097630 630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:47.097774 630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:47.097930 630 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:54:47.098060 630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:47.107910 630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:47.109154 630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:47.111012 630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:47.124481 640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:47.124536 637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:47.124536 638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:47.125536 630 server_base.cc:1034] running on GCE node
I20260811 18:54:47.126171 630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:47.127322 630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:47.128548 630 hybrid_clock.cc:648] HybridClock initialized: now 1786474487128477 us; error 45 us; skew 500 ppm
I20260811 18:54:47.128824 630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:47 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474487, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:47.132006 630 init.cc:377] Logged in from keytab as oryx/127.19.155.193@KRBTEST.COM (short username oryx)
I20260811 18:54:47.133446 630 webserver.cc:460] Webserver started at http://127.19.155.193:44327/ using document root <none> and password file <none>
I20260811 18:54:47.134128 630 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:47.134220 630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:47.134485 630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:47.137625 630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "215f8d2906b24e939156ebea7a62e7cf"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "720a7c0b1572462eec70331c13508097"
server_key_iv: "09cd8ab9539da1168136924e34f12917"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.138415 630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "215f8d2906b24e939156ebea7a62e7cf"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "720a7c0b1572462eec70331c13508097"
server_key_iv: "09cd8ab9539da1168136924e34f12917"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.145222 630 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260811 18:54:47.152043 653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:47.153681 630 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260811 18:54:47.153853 630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "215f8d2906b24e939156ebea7a62e7cf"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "720a7c0b1572462eec70331c13508097"
server_key_iv: "09cd8ab9539da1168136924e34f12917"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.154072 630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:47.206463 630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:47.210635 630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:47.210987 630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:47.213675 630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:47.213794 630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:47.213934 630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:47.214015 630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:54:47 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474487, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:47.238844 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.214569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:42829 (local address 127.19.155.254:34369)
0811 18:54:47.215097 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:47.215104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:47.216472 (+ 1368us) server_negotiation.cc:407] Connection header received
0811 18:54:47.219750 (+ 3278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:47.219761 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:47.219866 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:47.219994 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:47.222246 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.223316 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.225676 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.226301 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.226439 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.230964 (+ 4525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:47.230970 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:47.230974 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:47.231008 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:47.235120 (+ 4112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.235876 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.235885 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.235891 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.236093 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.236563 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.236570 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.236577 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.237041 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:47.237229 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:47.237953 (+ 724us) server_negotiation.cc:299] Negotiation successful
0811 18:54:47.238271 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":246,"threads_started":1}
I20260811 18:54:47.239404 673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.215308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.193:42829)
0811 18:54:47.216214 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:47.216284 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:47.219276 (+ 2992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:47.220305 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:47.220320 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:47.221155 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:47.222048 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.222070 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.223494 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.223502 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.225513 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.225527 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.226575 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.226583 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.227001 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.227850 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:47.227904 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:47.230694 (+ 2790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:47.235292 (+ 4598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.235299 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.235314 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.235744 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.236229 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.236233 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.236235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.236442 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.237176 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:47.237182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:47.237546 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 18:54:47.237780 (+ 234us) client_negotiation.cc:240] Negotiation successful
0811 18:54:47.238171 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":357,"threads_started":1}
I20260811 18:54:47.267974 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.250426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:50377 (local address 127.19.155.254:34369)
0811 18:54:47.250629 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:47.250638 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:47.251606 (+ 968us) server_negotiation.cc:407] Connection header received
0811 18:54:47.251845 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:47.251854 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:47.251977 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:47.252119 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:47.253473 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.254200 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.255903 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.256527 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.256677 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.260207 (+ 3530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:47.260217 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:47.260221 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:47.260256 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:47.263737 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.265082 (+ 1345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.265091 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.265097 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.265280 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.265874 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.265882 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.265888 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.266346 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:47.266550 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:47.267495 (+ 945us) server_negotiation.cc:299] Negotiation successful
0811 18:54:47.267726 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:54:47.268671 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.250527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.193:50377)
0811 18:54:47.251450 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:47.251474 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:47.251663 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:47.252145 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:47.252149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:47.252717 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:47.253303 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.253317 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.254350 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.254357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.255725 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.255740 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.256825 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.256835 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.257111 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.258012 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:47.258042 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:47.259937 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:47.263971 (+ 4034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.263978 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.264004 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.264863 (+ 859us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.265479 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.265484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.265487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.265694 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.266655 (+ 961us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:47.266663 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:47.267108 (+ 445us) client_negotiation.cc:769] Sending connection context
0811 18:54:47.267333 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 18:54:47.267941 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":470,"threads_started":1}
I20260811 18:54:47.274582 630 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40427
I20260811 18:54:47.274627 847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40427 every 8 connection(s)
I20260811 18:54:47.275877 630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:47.278005 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 630
I20260811 18:54:47.278157 850 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34369
I20260811 18:54:47.278226 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:47.278396 850 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:47.279320 20079 external_mini_cluster.cc:1428] Setting key 582056213f586c04c65a1936397aaabd
I20260811 18:54:47.279408 850 heartbeater.cc:511] Master 127.19.155.254:34369 requested a full tablet report, sending...
I20260811 18:54:47.282141 517 ts_manager.cc:194] Registered new tserver with Master: 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427)
I20260811 18:54:47.284381 517 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:42829
WARNING: no policy specified for oryx/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
I20260811 18:54:47.338387 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34369
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:47.673125 857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:47.673421 857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:47.673642 857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:47.681121 857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:47.681227 857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:47.681401 857 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:54:47.681546 857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:47.691385 857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:47.692720 857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:47.694068 857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:47.707018 866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:47.706976 870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:47.706949 867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:47.708067 857 server_base.cc:1034] running on GCE node
I20260811 18:54:47.708719 857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:47.709551 857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:47.710760 857 hybrid_clock.cc:648] HybridClock initialized: now 1786474487710699 us; error 31 us; skew 500 ppm
I20260811 18:54:47.711093 857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:47 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474487, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:47.714145 857 init.cc:377] Logged in from keytab as oryx/127.19.155.194@KRBTEST.COM (short username oryx)
I20260811 18:54:47.715814 857 webserver.cc:460] Webserver started at http://127.19.155.194:34319/ using document root <none> and password file <none>
I20260811 18:54:47.716490 857 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:47.716634 857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:47.716951 857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:47.719888 857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "bfc2d8907d2140009c98b4a14492e75e"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "253e22c2649eb0daae17546e4cc07290"
server_key_iv: "bb24533b1d497bd1346ed4d1c6bd6d41"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.720670 857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "bfc2d8907d2140009c98b4a14492e75e"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "253e22c2649eb0daae17546e4cc07290"
server_key_iv: "bb24533b1d497bd1346ed4d1c6bd6d41"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.725670 857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:47.729002 877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:47.730222 857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:47.730396 857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "bfc2d8907d2140009c98b4a14492e75e"
format_stamp: "Formatted at 2026-08-11 18:54:47 on dist-test-slave-1nl6"
server_key: "253e22c2649eb0daae17546e4cc07290"
server_key_iv: "bb24533b1d497bd1346ed4d1c6bd6d41"
server_key_version: "encryptionkey@0"
I20260811 18:54:47.730607 857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:47.753584 857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:47.757604 857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:47.757886 857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:47.760725 857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:47.760841 857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:47.761021 857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:47.761108 857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:54:47 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474487, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:47.787881 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.761780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.194:59437)
0811 18:54:47.762747 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:47.762797 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:47.764720 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:47.765497 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:47.765505 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:47.766279 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:47.767306 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.767342 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.769122 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.769131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.771958 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.771978 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.773176 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.773182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.773468 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.774247 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:47.774276 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:47.777839 (+ 3563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:47.781964 (+ 4125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.781979 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.781999 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.782574 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.783106 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.783113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.783119 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.783445 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.784170 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:47.784182 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:47.784750 (+ 568us) client_negotiation.cc:769] Sending connection context
0811 18:54:47.785152 (+ 402us) client_negotiation.cc:240] Negotiation successful
0811 18:54:47.785846 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":420,"threads_started":1}
I20260811 18:54:47.789307 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.761116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:59437 (local address 127.19.155.254:34369)
0811 18:54:47.761339 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:47.761346 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:47.762945 (+ 1599us) server_negotiation.cc:407] Connection header received
0811 18:54:47.765017 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:47.765023 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:47.765121 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:47.765234 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:47.767566 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.768889 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.772155 (+ 3266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.772695 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.772862 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.778093 (+ 5231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:47.778098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:47.778101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:47.778133 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:47.781798 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.782729 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.782735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.782740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.782935 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.783612 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.783617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.783621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.784013 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:47.784212 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:47.788565 (+ 4353us) server_negotiation.cc:299] Negotiation successful
0811 18:54:47.788851 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:54:47.809073 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.795111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:54137 (local address 127.19.155.254:34369)
0811 18:54:47.795337 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:47.795345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:47.796004 (+ 659us) server_negotiation.cc:407] Connection header received
0811 18:54:47.796212 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:47.796220 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:47.796320 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:47.796446 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:47.797362 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.798498 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.800539 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.801151 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.801285 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.803097 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:47.803104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:47.803108 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:47.803145 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:47.806430 (+ 3285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.807118 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.807123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.807126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.807273 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:47.807665 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:47.807672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:47.807680 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:47.807980 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:47.808132 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:47.808533 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 18:54:47.808742 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:54:47.809201 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:47.795181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.194:54137)
0811 18:54:47.795866 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:47.795901 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:47.796063 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:47.796509 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:47.796514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:47.796933 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:47.797213 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.797222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.798627 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.798631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.800378 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:47.800395 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:47.801358 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:47.801364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:47.801516 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:47.802162 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:47.802177 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:47.802864 (+ 687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:47.806553 (+ 3689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.806558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.806562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.807005 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.807404 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:47.807409 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:47.807412 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:47.807546 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:47.808101 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:47.808106 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:47.808290 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 18:54:47.808429 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:54:47.808743 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":386,"threads_started":1}
I20260811 18:54:47.810817 857 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:40289
I20260811 18:54:47.810846 1053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:40289 every 8 connection(s)
I20260811 18:54:47.812382 857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:47.813794 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 857
I20260811 18:54:47.813977 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:47.814504 20079 external_mini_cluster.cc:1428] Setting key 0f1408e84eb49af0843d7e4466ea58ba
I20260811 18:54:47.814584 1054 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34369
I20260811 18:54:47.815793 1054 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:47.816587 1054 heartbeater.cc:511] Master 127.19.155.254:34369 requested a full tablet report, sending...
I20260811 18:54:47.817834 517 ts_manager.cc:194] Registered new tserver with Master: bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:47.818599 517 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:59437
WARNING: no policy specified for oryx/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
I20260811 18:54:47.868196 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34369
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:48.209123 1060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:48.209419 1060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:48.209519 1060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:48.216742 1060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:48.216897 1060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:48.217097 1060 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:54:48.217267 1060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:48.227977 1060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.155.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:48.229357 1060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:48.230734 1060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:48.251350 1072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:48.251591 1067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:48.251317 1069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:48.253054 1060 server_base.cc:1034] running on GCE node
I20260811 18:54:48.253742 1060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:48.254760 1060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:48.256017 1060 hybrid_clock.cc:648] HybridClock initialized: now 1786474488255930 us; error 62 us; skew 500 ppm
I20260811 18:54:48.256346 1060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474488, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:48.260195 1060 init.cc:377] Logged in from keytab as oryx/127.19.155.195@KRBTEST.COM (short username oryx)
I20260811 18:54:48.262107 1060 webserver.cc:460] Webserver started at http://127.19.155.195:34597/ using document root <none> and password file <none>
I20260811 18:54:48.263060 1060 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:48.263200 1060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:48.263602 1060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:48.268214 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "b963da116dd04d088ca1fc563c946946"
format_stamp: "Formatted at 2026-08-11 18:54:48 on dist-test-slave-1nl6"
server_key: "3656c42caac60d1bf0aabeb85c12d954"
server_key_iv: "aaaf6445375aca18f0e0aa64316929e0"
server_key_version: "encryptionkey@0"
I20260811 18:54:48.269421 1060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "b963da116dd04d088ca1fc563c946946"
format_stamp: "Formatted at 2026-08-11 18:54:48 on dist-test-slave-1nl6"
server_key: "3656c42caac60d1bf0aabeb85c12d954"
server_key_iv: "aaaf6445375aca18f0e0aa64316929e0"
server_key_version: "encryptionkey@0"
I20260811 18:54:48.276907 1060 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260811 18:54:48.281661 1083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:48.283281 1060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:48.283449 1060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "b963da116dd04d088ca1fc563c946946"
format_stamp: "Formatted at 2026-08-11 18:54:48 on dist-test-slave-1nl6"
server_key: "3656c42caac60d1bf0aabeb85c12d954"
server_key_iv: "aaaf6445375aca18f0e0aa64316929e0"
server_key_version: "encryptionkey@0"
I20260811 18:54:48.283707 1060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:48.287233 850 heartbeater.cc:503] Master 127.19.155.254:34369 was elected leader, sending a full tablet report...
I20260811 18:54:48.305301 1060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:48.310098 1060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:48.310420 1060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:48.313251 1060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:48.313373 1060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:48.313576 1060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:48.313661 1060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474488, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:48.340989 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.315348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:37165 (local address 127.19.155.254:34369)
0811 18:54:48.321403 (+ 6055us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.321413 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.321438 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:54:48.321513 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.321519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.321611 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.323019 (+ 1408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:48.323539 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.324396 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.327536 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.328185 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.328331 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.332859 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:48.332868 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:48.332879 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:48.332913 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:48.337064 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.338194 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.338199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.338202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.338395 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.339047 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.339053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.339059 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.339404 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:48.339578 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.340333 (+ 755us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.340602 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5907,"thread_start_us":5792,"threads_started":1}
I20260811 18:54:48.342348 1097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.315059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.195:37165)
0811 18:54:48.316218 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.316288 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.319719 (+ 3431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.321994 (+ 2275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.322003 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.322514 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:48.323271 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.323301 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.324631 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.324637 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.327368 (+ 2731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.327383 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.328436 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.328446 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.328688 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.329391 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:48.329413 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:48.332591 (+ 3178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:48.337274 (+ 4683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.337292 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.337312 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.338005 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.338560 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.338566 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.338570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.338801 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.339547 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:48.339555 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:48.339934 (+ 379us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.340210 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.340759 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":440,"threads_started":1}
I20260811 18:54:48.366346 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.349495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:33821 (local address 127.19.155.254:34369)
0811 18:54:48.349668 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.349673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.349994 (+ 321us) server_negotiation.cc:407] Connection header received
0811 18:54:48.350195 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.350202 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.350307 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.350413 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:48.352184 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.353832 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.355946 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.356510 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.356629 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.359165 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:48.359172 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:48.359177 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:48.359213 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:48.362614 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.363592 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.363600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.363606 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.363796 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.364245 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.364252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.364258 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.364658 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:48.364804 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.365720 (+ 916us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.365970 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:54:48.367654 1179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.348997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.19.155.195:33821)
0811 18:54:48.349891 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.349907 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.350060 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.350596 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.350601 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.351456 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:48.351938 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.351956 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.354068 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.354077 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.355795 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.355808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.356904 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.356910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.357114 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.357880 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:48.357902 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:48.358943 (+ 1041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:48.362785 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.362790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.362794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.363432 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.363942 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.363947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.363950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.364098 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.364885 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:48.364891 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:48.365151 (+ 260us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.365305 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.367050 (+ 1745us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":544,"threads_started":1}
I20260811 18:54:48.380770 1257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:39697 every 8 connection(s)
I20260811 18:54:48.380831 1060 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:39697
I20260811 18:54:48.382615 1060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:48.385180 1261 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34369
I20260811 18:54:48.385423 1261 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:48.386264 1261 heartbeater.cc:511] Master 127.19.155.254:34369 requested a full tablet report, sending...
I20260811 18:54:48.386270 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 1060
I20260811 18:54:48.386443 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:48.387044 20079 external_mini_cluster.cc:1428] Setting key 1c7cee0680ec2731da8094927638f37e
I20260811 18:54:48.388022 517 ts_manager.cc:194] Registered new tserver with Master: b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697)
I20260811 18:54:48.389427 517 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:37165
I20260811 18:54:48.390401 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474488, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:54:48.449990 1099 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:48.438983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42422 (local address 127.19.155.254:34369)
0811 18:54:48.439232 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.439239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.439422 (+ 183us) server_negotiation.cc:407] Connection header received
0811 18:54:48.439603 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.439608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.439676 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.439765 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:48.441088 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.441868 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.443276 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.443661 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.443761 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.449667 (+ 5906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42422: BlockingRecv error: recv got EOF from 127.0.0.1:42422 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474488, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:48.465934 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.453241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.19.155.254:34369)
0811 18:54:48.453463 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.453468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.453674 (+ 206us) server_negotiation.cc:407] Connection header received
0811 18:54:48.453826 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.453830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.453887 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.453968 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:48.455050 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.455715 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.456828 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.457235 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.457336 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.461037 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:48.461041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:48.461045 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:48.461075 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:48.463718 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.464323 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.464327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.464329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.464450 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.464748 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.464752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.464755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.464994 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:48.465168 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.465406 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.465632 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:54:48.470026 518 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:48.477192 518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:48.511209 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.489074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.19.155.193:40427)
0811 18:54:48.501133 (+ 12059us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.501145 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.501184 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:54:48.501318 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.501330 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.501644 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.501868 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.503286 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.505074 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.508022 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.509480 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.509675 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.509859 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.510705 (+ 846us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.510870 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11832,"thread_start_us":13019,"threads_started":1}
I20260811 18:54:48.511353 1290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.488879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40427 (local address 127.0.0.1:43640)
0811 18:54:48.500109 (+ 11230us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.500165 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.500420 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.502423 (+ 2003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.502435 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.502486 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.503021 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.503038 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.505274 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.505279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.507845 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.507860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.509713 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.509720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.509933 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.509976 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.510119 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.510317 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10880,"thread_start_us":14475,"threads_started":1}
I20260811 18:54:48.512889 1294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.491717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:40289 (local address 127.0.0.1:46236)
0811 18:54:48.505445 (+ 13728us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.505470 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.505605 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.506215 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.506220 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.506256 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.506750 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.506769 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.508424 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.508429 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.510030 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.510051 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.512221 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.512228 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.512410 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.512449 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.512552 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.512670 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13590,"thread_start_us":13447,"threads_started":1}
I20260811 18:54:48.513926 1288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.489088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:39697 (local address 127.0.0.1:53372)
0811 18:54:48.503099 (+ 14011us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.503123 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.503264 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.505761 (+ 2497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.505766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.505789 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.506449 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.506472 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.509398 (+ 2926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.509404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.511585 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.511600 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.513408 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.513412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.513523 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.513544 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.513596 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.513668 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13831,"mutex_wait_us":78,"thread_start_us":10473,"threads_started":1}
I20260811 18:54:48.514175 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.489831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53372 (local address 127.19.155.195:39697)
0811 18:54:48.504997 (+ 15166us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.505006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.505043 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:54:48.505143 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.505153 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.505422 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.505646 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.507584 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.509248 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.511791 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.513225 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.513433 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.513605 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.513700 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.513860 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14979,"thread_start_us":15538,"threads_started":1}
I20260811 18:54:48.515512 1296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.492403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.19.155.194:40289)
0811 18:54:48.504955 (+ 12552us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.504966 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.505641 (+ 675us) server_negotiation.cc:407] Connection header received
0811 18:54:48.505750 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.505757 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.505999 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.506206 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.506989 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.508293 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.510247 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.511993 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.512190 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.512366 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.515021 (+ 2655us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.515208 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12360,"thread_start_us":12211,"threads_started":1}
I20260811 18:54:48.515631 734 tablet_service.cc:1467] Processing CreateTablet for tablet 641cb5f8a8b2495e84740938e6329a21 (DEFAULT_TABLE table=test-table [id=2117944bac9b41248f39e662aa054488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.517266 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641cb5f8a8b2495e84740938e6329a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.517729 1156 tablet_service.cc:1467] Processing CreateTablet for tablet 641cb5f8a8b2495e84740938e6329a21 (DEFAULT_TABLE table=test-table [id=2117944bac9b41248f39e662aa054488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.518157 948 tablet_service.cc:1467] Processing CreateTablet for tablet 641cb5f8a8b2495e84740938e6329a21 (DEFAULT_TABLE table=test-table [id=2117944bac9b41248f39e662aa054488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.519157 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641cb5f8a8b2495e84740938e6329a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.519404 948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641cb5f8a8b2495e84740938e6329a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.534670 1298 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Bootstrap starting.
I20260811 18:54:48.534650 1301 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Bootstrap starting.
I20260811 18:54:48.538544 1298 tablet_bootstrap.cc:654] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.539242 1301 tablet_bootstrap.cc:654] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.539325 1297 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Bootstrap starting.
I20260811 18:54:48.540033 1298 log.cc:824] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:48.540804 1301 log.cc:824] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:48.542735 1297 tablet_bootstrap.cc:654] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.543704 1298 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: No bootstrap required, opened a new log
I20260811 18:54:48.543969 1298 ts_tablet_manager.cc:1397] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 18:54:48.543994 1297 log.cc:824] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:48.544868 1301 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: No bootstrap required, opened a new log
I20260811 18:54:48.545128 1301 ts_tablet_manager.cc:1397] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 18:54:48.547034 1297 tablet_bootstrap.cc:492] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: No bootstrap required, opened a new log
I20260811 18:54:48.547282 1297 ts_tablet_manager.cc:1397] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 18:54:48.551851 1298 raft_consensus.cc:348] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.552433 1298 raft_consensus.cc:374] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.552600 1298 raft_consensus.cc:729] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.553355 1298 consensus_queue.cc:260] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.555100 1298 ts_tablet_manager.cc:1428] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260811 18:54:48.555768 1301 raft_consensus.cc:348] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.556252 1301 raft_consensus.cc:374] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.556403 1301 raft_consensus.cc:729] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b963da116dd04d088ca1fc563c946946, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.557129 1301 consensus_queue.cc:260] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.558452 1261 heartbeater.cc:503] Master 127.19.155.254:34369 was elected leader, sending a full tablet report...
I20260811 18:54:48.557952 1297 raft_consensus.cc:348] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.559041 1297 raft_consensus.cc:374] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.559170 1301 ts_tablet_manager.cc:1428] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260811 18:54:48.559172 1297 raft_consensus.cc:729] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc2d8907d2140009c98b4a14492e75e, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.559839 1297 consensus_queue.cc:260] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.560998 1054 heartbeater.cc:503] Master 127.19.155.254:34369 was elected leader, sending a full tablet report...
I20260811 18:54:48.561765 1297 ts_tablet_manager.cc:1428] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260811 18:54:48.565351 1055 tablet.cc:2369] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:54:48.634461 1262 tablet.cc:2369] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:48.704064 1308 raft_consensus.cc:482] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:48.704411 1308 raft_consensus.cc:504] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.706185 1308 leader_election.cc:288] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:48.713055 1296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.706625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:37635 (local address 127.19.155.194:40289)
0811 18:54:48.706821 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.706826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.707717 (+ 891us) server_negotiation.cc:407] Connection header received
0811 18:54:48.707953 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.707959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.708034 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.708133 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.708721 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.709486 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.711341 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.712104 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.712326 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.712400 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.712665 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.712801 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:54:48.713111 1311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.706612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:40289 (local address 127.19.155.193:37635)
0811 18:54:48.707594 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.707616 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.707799 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.708160 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.708165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.708194 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.708577 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.708586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.709619 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.709626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.711178 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.711194 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.712351 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.712357 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.712503 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.712527 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.712641 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.712769 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":580,"threads_started":1}
I20260811 18:54:48.713429 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.706803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:34087 (local address 127.19.155.195:39697)
0811 18:54:48.707094 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.707102 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.708255 (+ 1153us) server_negotiation.cc:407] Connection header received
0811 18:54:48.708494 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.708500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.708578 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.708678 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.709240 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.709923 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.711665 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.712454 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.712634 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.712721 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.713005 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.713129 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 18:54:48.713624 1312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.707326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:39697 (local address 127.19.155.193:34087)
0811 18:54:48.708139 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.708155 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.708339 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.708704 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.708708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.708732 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.709065 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.709073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.710075 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.710080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.711506 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.711519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.712695 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.712702 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.712845 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.712868 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.712976 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.713093 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":1,"thread_start_us":469,"threads_started":1}
I20260811 18:54:48.714372 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641cb5f8a8b2495e84740938e6329a21" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e" is_pre_election: true
I20260811 18:54:48.714754 1197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641cb5f8a8b2495e84740938e6329a21" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946" is_pre_election: true
I20260811 18:54:48.714958 976 raft_consensus.cc:2454] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 0.
I20260811 18:54:48.715349 1197 raft_consensus.cc:2454] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 0.
I20260811 18:54:48.715646 660 leader_election.cc:302] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, bfc2d8907d2140009c98b4a14492e75e; no voters:
I20260811 18:54:48.716097 1308 raft_consensus.cc:2781] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:48.716254 1308 raft_consensus.cc:482] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:48.716368 1308 raft_consensus.cc:3037] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.718564 1308 raft_consensus.cc:504] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.719214 1308 leader_election.cc:288] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Requested vote from peers b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:48.719589 1197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641cb5f8a8b2495e84740938e6329a21" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946"
I20260811 18:54:48.719798 1197 raft_consensus.cc:3037] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.719771 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641cb5f8a8b2495e84740938e6329a21" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e"
I20260811 18:54:48.719973 976 raft_consensus.cc:3037] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.723116 1197 raft_consensus.cc:2454] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:48.723116 976 raft_consensus.cc:2454] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:48.723564 657 leader_election.cc:302] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946, bfc2d8907d2140009c98b4a14492e75e; no voters:
I20260811 18:54:48.723881 1308 raft_consensus.cc:2781] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:48.724315 1308 raft_consensus.cc:686] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 1 LEADER]: Becoming Leader. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Running, Role: LEADER
I20260811 18:54:48.724879 1308 consensus_queue.cc:237] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } }
I20260811 18:54:48.729188 518 catalog_manager.cc:5495] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193). New cstate: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:48.749688 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.744508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.19.155.193:40427)
0811 18:54:48.744700 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.744707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.744803 (+ 96us) server_negotiation.cc:407] Connection header received
0811 18:54:48.745035 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.745039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.745108 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.745269 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:48.745649 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.746334 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.747722 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.748108 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.748252 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.748670 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:48.749134 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:48.749311 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.749367 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.749439 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:54:48.757370 1197 raft_consensus.cc:1261] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:48.757404 976 raft_consensus.cc:1261] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:48.758347 1313 consensus_queue.cc:1035] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:48.758646 1308 consensus_queue.cc:1035] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:48.770284 1320 mvcc.cc:205] Tried to move back new op lower bound from 7317399505941553152 to 7317399505820848128. Current Snapshot: MvccSnapshot[applied={T|T < 7317399505941553152}]
I20260811 18:54:48.788089 518 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:48.788348 518 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:48.791841 518 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Sending DeleteTablet for 3 replicas of tablet 641cb5f8a8b2495e84740938e6329a21
I20260811 18:54:48.792940 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 641cb5f8a8b2495e84740938e6329a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:48 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43640
I20260811 18:54:48.793020 1156 tablet_service.cc:1514] Processing DeleteTablet for tablet 641cb5f8a8b2495e84740938e6329a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:48 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53372
I20260811 18:54:48.793283 948 tablet_service.cc:1514] Processing DeleteTablet for tablet 641cb5f8a8b2495e84740938e6329a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:48 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46236
I20260811 18:54:48.795711 518 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:48.796533 518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:48.805516 1333 tablet_replica.cc:330] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: stopping tablet replica
I20260811 18:54:48.806128 1333 raft_consensus.cc:2229] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:48.806934 1333 raft_consensus.cc:2258] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:48.807557 1155 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c (DEFAULT_TABLE table=test-table [id=58b84dc5148b4d618fe93672b95e220d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.807971 947 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c (DEFAULT_TABLE table=test-table [id=58b84dc5148b4d618fe93672b95e220d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.808161 1155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd941d9d8634ed7ad245ab6e533618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.808490 947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd941d9d8634ed7ad245ab6e533618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.817572 1335 tablet_replica.cc:330] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: stopping tablet replica
I20260811 18:54:48.817981 1335 raft_consensus.cc:2229] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:48.818485 1335 raft_consensus.cc:2258] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:48.819327 1334 tablet_replica.cc:330] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: stopping tablet replica
I20260811 18:54:48.819710 1334 raft_consensus.cc:2229] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:48.819864 1297 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Bootstrap starting.
I20260811 18:54:48.820217 1334 raft_consensus.cc:2258] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:48.821574 1297 tablet_bootstrap.cc:654] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.821569 1335 ts_tablet_manager.cc:1905] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:48.823343 1334 ts_tablet_manager.cc:1905] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:48.829715 1301 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Bootstrap starting.
I20260811 18:54:48.829829 1334 ts_tablet_manager.cc:1918] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:48.830003 1334 log.cc:1196] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/641cb5f8a8b2495e84740938e6329a21
I20260811 18:54:48.814844 734 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c (DEFAULT_TABLE table=test-table [id=58b84dc5148b4d618fe93672b95e220d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:48.830474 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd941d9d8634ed7ad245ab6e533618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.830572 1334 ts_tablet_manager.cc:1939] T 641cb5f8a8b2495e84740938e6329a21 P b963da116dd04d088ca1fc563c946946: Deleting consensus metadata
I20260811 18:54:48.831851 1301 tablet_bootstrap.cc:654] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.832412 496 catalog_manager.cc:4841] TS b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697): tablet 641cb5f8a8b2495e84740938e6329a21 (table test-table [id=2117944bac9b41248f39e662aa054488]) successfully deleted
I20260811 18:54:48.836843 1333 ts_tablet_manager.cc:1905] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:48.837225 1335 ts_tablet_manager.cc:1918] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:48.837400 1335 log.cc:1196] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/641cb5f8a8b2495e84740938e6329a21
I20260811 18:54:48.837963 1335 ts_tablet_manager.cc:1939] T 641cb5f8a8b2495e84740938e6329a21 P bfc2d8907d2140009c98b4a14492e75e: Deleting consensus metadata
I20260811 18:54:48.840296 1298 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Bootstrap starting.
I20260811 18:54:48.841804 1297 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: No bootstrap required, opened a new log
I20260811 18:54:48.841974 1297 ts_tablet_manager.cc:1397] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.005s
I20260811 18:54:48.842060 1298 tablet_bootstrap.cc:654] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.843336 1297 raft_consensus.cc:348] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.843571 1297 raft_consensus.cc:374] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.843679 1297 raft_consensus.cc:729] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc2d8907d2140009c98b4a14492e75e, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.843998 1297 consensus_queue.cc:260] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.845826 1297 ts_tablet_manager.cc:1428] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 18:54:48.847605 1301 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: No bootstrap required, opened a new log
I20260811 18:54:48.847759 1301 ts_tablet_manager.cc:1397] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.004s
I20260811 18:54:48.848522 1301 raft_consensus.cc:348] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.848762 1301 raft_consensus.cc:374] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.848877 1301 raft_consensus.cc:729] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b963da116dd04d088ca1fc563c946946, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.849169 1301 consensus_queue.cc:260] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.849766 1301 ts_tablet_manager.cc:1428] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 18:54:48.850284 500 catalog_manager.cc:4841] TS bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289): tablet 641cb5f8a8b2495e84740938e6329a21 (table test-table [id=2117944bac9b41248f39e662aa054488]) successfully deleted
I20260811 18:54:48.859818 1298 tablet_bootstrap.cc:492] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: No bootstrap required, opened a new log
I20260811 18:54:48.859992 1298 ts_tablet_manager.cc:1397] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260811 18:54:48.860743 1298 raft_consensus.cc:348] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.861002 1298 raft_consensus.cc:374] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.861112 1298 raft_consensus.cc:729] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.861397 1298 consensus_queue.cc:260] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.861965 1298 ts_tablet_manager.cc:1428] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:54:48.865573 1333 ts_tablet_manager.cc:1918] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:48.865765 1333 log.cc:1196] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/641cb5f8a8b2495e84740938e6329a21
I20260811 18:54:48.866288 1333 ts_tablet_manager.cc:1939] T 641cb5f8a8b2495e84740938e6329a21 P 215f8d2906b24e939156ebea7a62e7cf: Deleting consensus metadata
I20260811 18:54:48.867782 499 catalog_manager.cc:4841] TS 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427): tablet 641cb5f8a8b2495e84740938e6329a21 (table test-table [id=2117944bac9b41248f39e662aa054488]) successfully deleted
I20260811 18:54:48.882609 1309 raft_consensus.cc:482] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:48.882826 1309 raft_consensus.cc:504] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.884284 1309 leader_election.cc:288] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:48.892439 1296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.884664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:52165 (local address 127.19.155.194:40289)
0811 18:54:48.884864 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.884872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.885793 (+ 921us) server_negotiation.cc:407] Connection header received
0811 18:54:48.885924 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.885930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.886005 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.886100 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.886768 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.887868 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.889996 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.891302 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.891475 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.891549 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.891992 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.892151 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:54:48.892591 1343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.884527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:40289 (local address 127.19.155.195:52165)
0811 18:54:48.885650 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.885681 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.885808 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.886150 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.886155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.886186 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.886570 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.886583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.888014 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.888024 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.889841 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.889854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.891491 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.891498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.891766 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.891810 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.891950 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.892095 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":24,"thread_start_us":856,"threads_started":1}
I20260811 18:54:48.892650 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.884914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:54969 (local address 127.19.155.193:40427)
0811 18:54:48.885082 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.885088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.885208 (+ 120us) server_negotiation.cc:407] Connection header received
0811 18:54:48.885578 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.885586 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.885679 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.885760 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:48.886456 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.887694 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.890316 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.891604 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.891783 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.891859 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.892216 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.892356 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:54:48.893395 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.884459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40427 (local address 127.19.155.195:54969)
0811 18:54:48.885093 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.885118 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.885384 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.885974 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.885979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.886005 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:48.886271 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.886285 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.887855 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.887862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.890156 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.890172 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.891827 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.891834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.892006 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.892037 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.892874 (+ 837us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.893006 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":55,"thread_start_us":664,"threads_started":1}
I20260811 18:54:48.893668 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd941d9d8634ed7ad245ab6e533618c" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e" is_pre_election: true
I20260811 18:54:48.893954 976 raft_consensus.cc:2454] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 0.
I20260811 18:54:48.894512 1087 leader_election.cc:302] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b963da116dd04d088ca1fc563c946946, bfc2d8907d2140009c98b4a14492e75e; no voters:
I20260811 18:54:48.894368 778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd941d9d8634ed7ad245ab6e533618c" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215f8d2906b24e939156ebea7a62e7cf" is_pre_election: true
I20260811 18:54:48.894865 1309 raft_consensus.cc:2781] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:48.894876 778 raft_consensus.cc:2454] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 0.
I20260811 18:54:48.895048 1309 raft_consensus.cc:482] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:48.895140 1309 raft_consensus.cc:3037] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.897353 1309 raft_consensus.cc:504] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.898066 1309 leader_election.cc:288] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 election: Requested vote from peers 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:48.898504 778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd941d9d8634ed7ad245ab6e533618c" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215f8d2906b24e939156ebea7a62e7cf"
I20260811 18:54:48.898561 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd941d9d8634ed7ad245ab6e533618c" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e"
I20260811 18:54:48.898725 778 raft_consensus.cc:3037] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.898780 976 raft_consensus.cc:3037] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:48.901693 778 raft_consensus.cc:2454] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 1.
I20260811 18:54:48.901788 976 raft_consensus.cc:2454] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 1.
I20260811 18:54:48.902132 1085 leader_election.cc:302] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946; no voters:
I20260811 18:54:48.902451 1309 raft_consensus.cc:2781] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:48.902961 1309 raft_consensus.cc:686] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 1 LEADER]: Becoming Leader. State: Replica: b963da116dd04d088ca1fc563c946946, State: Running, Role: LEADER
I20260811 18:54:48.903376 1309 consensus_queue.cc:237] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.907176 517 catalog_manager.cc:5495] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 reported cstate change: term changed from 0 to 1, leader changed from <none> to b963da116dd04d088ca1fc563c946946 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "b963da116dd04d088ca1fc563c946946" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } health_report { overall_health: HEALTHY } } }
Aug 11 18:54:48 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474486, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.254@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:48.960497 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.945643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42438 (local address 127.19.155.254:34369)
0811 18:54:48.945900 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:48.945907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:48.946450 (+ 543us) server_negotiation.cc:407] Connection header received
0811 18:54:48.946599 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:48.946605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:48.946697 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:48.946815 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:48.947978 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.949122 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.950627 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.951367 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.951489 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.955053 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:48.955058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:48.955061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:48.955088 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:48.957748 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.958437 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.958445 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.958448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.958575 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:48.959001 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:48.959007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:48.959011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:48.959245 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:48.959395 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:48.959830 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 18:54:48.960148 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":109}
I20260811 18:54:48.960520 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:48.945659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34369 (local address 127.0.0.1:42438)
0811 18:54:48.946346 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:48.946362 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:48.946485 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:48.946848 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:48.946852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:48.947557 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:48.947830 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.947840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.949298 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.949305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.950493 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:48.950504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:48.951533 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:48.951538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:48.951650 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:48.952360 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:48.952378 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:48.954874 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:48.957875 (+ 3001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.957889 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.957897 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.958321 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.958681 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:48.958686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:48.958690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:48.958848 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:48.959382 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:48.959389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:48.959549 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 18:54:48.959728 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 18:54:48.960007 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":374,"threads_started":1}
I20260811 18:54:48.965714 517 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:42438:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:54:48.966841 517 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:48.974001 734 tablet_service.cc:1467] Processing CreateTablet for tablet 34e88f89e5d440598cd42348aab43ac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c3bc4f10a19249f68b7c59b7575ad2a5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:54:48.974629 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e88f89e5d440598cd42348aab43ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.975350 1156 tablet_service.cc:1467] Processing CreateTablet for tablet 34e88f89e5d440598cd42348aab43ac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c3bc4f10a19249f68b7c59b7575ad2a5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:54:48.975950 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e88f89e5d440598cd42348aab43ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.981868 1301 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: Bootstrap starting.
I20260811 18:54:48.982009 1298 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: Bootstrap starting.
I20260811 18:54:48.982434 947 tablet_service.cc:1467] Processing CreateTablet for tablet 34e88f89e5d440598cd42348aab43ac6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c3bc4f10a19249f68b7c59b7575ad2a5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:54:48.983011 947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e88f89e5d440598cd42348aab43ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:48.983623 1301 tablet_bootstrap.cc:654] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.983815 1298 tablet_bootstrap.cc:654] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.992172 1297 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: Bootstrap starting.
I20260811 18:54:48.994168 1297 tablet_bootstrap.cc:654] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:48.996012 1298 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: No bootstrap required, opened a new log
I20260811 18:54:48.996205 1298 ts_tablet_manager.cc:1397] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.010s
I20260811 18:54:48.997020 1301 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: No bootstrap required, opened a new log
I20260811 18:54:48.996970 1298 raft_consensus.cc:348] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.997267 1298 raft_consensus.cc:374] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:48.997363 1298 raft_consensus.cc:729] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Initialized, Role: FOLLOWER
I20260811 18:54:48.997485 1301 ts_tablet_manager.cc:1397] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.011s
I20260811 18:54:48.997658 1298 consensus_queue.cc:260] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:48.998124 1308 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:48.998405 1308 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:48.998692 1301 raft_consensus.cc:348] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.000061 1298 ts_tablet_manager.cc:1428] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260811 18:54:48.999133 1301 raft_consensus.cc:374] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.002007 1301 raft_consensus.cc:729] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b963da116dd04d088ca1fc563c946946, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.002457 1301 consensus_queue.cc:260] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.003647 1309 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.003933 1309 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:49.004472 1301 ts_tablet_manager.cc:1428] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 18:54:49.005404 1297 tablet_bootstrap.cc:492] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: No bootstrap required, opened a new log
I20260811 18:54:49.005585 1297 ts_tablet_manager.cc:1397] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260811 18:54:49.006376 1297 raft_consensus.cc:348] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.006656 1297 raft_consensus.cc:374] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.006757 1297 raft_consensus.cc:729] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc2d8907d2140009c98b4a14492e75e, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.007050 1297 consensus_queue.cc:260] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.007745 1297 ts_tablet_manager.cc:1428] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:54:49.007616 1310 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.008039 1310 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 18:54:49.029838 851 tablet.cc:2369] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:49.105268 1308 raft_consensus.cc:482] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:49.105515 1308 raft_consensus.cc:504] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.106344 1308 leader_election.cc:288] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289), b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697)
I20260811 18:54:49.106937 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e88f89e5d440598cd42348aab43ac6" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e" is_pre_election: true
I20260811 18:54:49.106957 1197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e88f89e5d440598cd42348aab43ac6" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946" is_pre_election: true
I20260811 18:54:49.107247 1197 raft_consensus.cc:2454] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 0.
I20260811 18:54:49.107234 976 raft_consensus.cc:2454] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 0.
I20260811 18:54:49.107712 657 leader_election.cc:302] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946; no voters:
I20260811 18:54:49.108060 1308 raft_consensus.cc:2781] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:49.108213 1308 raft_consensus.cc:482] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:49.108323 1308 raft_consensus.cc:3037] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.110492 1308 raft_consensus.cc:504] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.111116 1308 leader_election.cc:288] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Requested vote from peers bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289), b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697)
I20260811 18:54:49.111486 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e88f89e5d440598cd42348aab43ac6" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e"
I20260811 18:54:49.111717 976 raft_consensus.cc:3037] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.111653 1197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34e88f89e5d440598cd42348aab43ac6" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946"
I20260811 18:54:49.111869 1197 raft_consensus.cc:3037] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.113729 976 raft_consensus.cc:2454] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:49.114179 660 leader_election.cc:302] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, bfc2d8907d2140009c98b4a14492e75e; no voters:
I20260811 18:54:49.114491 1308 raft_consensus.cc:2781] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:49.114681 1308 raft_consensus.cc:686] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [term 1 LEADER]: Becoming Leader. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Running, Role: LEADER
I20260811 18:54:49.115110 1197 raft_consensus.cc:2454] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:49.115293 1308 consensus_queue.cc:237] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.117264 1328 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: TxnStatusTablet state changed. Reason: New leader 215f8d2906b24e939156ebea7a62e7cf. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.117645 1328 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:54:49.118467 1371 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:54:49.118728 1371 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:54:49.118880 517 catalog_manager.cc:5495] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193). New cstate: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:49.143338 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.137502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43648 (local address 127.19.155.193:40427)
0811 18:54:49.137692 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.137696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.137716 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:49.138016 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.138020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.138084 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.138198 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.138617 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.139454 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.141442 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.141907 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.142019 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.142592 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.142688 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.142762 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.143018 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.143096 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:54:49.143436 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.137319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40427 (local address 127.0.0.1:43648)
0811 18:54:49.137620 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:49.137643 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:49.137810 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:49.138251 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:49.138256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:49.138269 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:49.138467 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.138480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.139620 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.139626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.141284 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.141301 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.142073 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.142082 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.142286 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.142374 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.142794 (+ 420us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.142818 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:54:49.142942 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 18:54:49.143117 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 18:54:49.147365 1197 raft_consensus.cc:1261] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.147400 976 raft_consensus.cc:1261] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.148089 1308 consensus_queue.cc:1035] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.148389 1328 consensus_queue.cc:1035] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.151855 1310 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: TxnStatusTablet state changed. Reason: New leader 215f8d2906b24e939156ebea7a62e7cf. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.152215 1310 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:49.153543 1308 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.153851 1308 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:54:49.154130 1319 mvcc.cc:205] Tried to move back new op lower bound from 7317399507541229568 to 7317399507419045888. Current Snapshot: MvccSnapshot[applied={T|T < 7317399507541229568 or (T in {7317399507541229568})}]
I20260811 18:54:49.161162 1310 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.161417 1310 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P bfc2d8907d2140009c98b4a14492e75e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:49.167891 1309 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: TxnStatusTablet state changed. Reason: New leader 215f8d2906b24e939156ebea7a62e7cf. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.168241 1309 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:49.168200 1308 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.168443 1308 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P 215f8d2906b24e939156ebea7a62e7cf: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:54:49.171058 1321 mvcc.cc:205] Tried to move back new op lower bound from 7317399507541229568 to 7317399507419045888. Current Snapshot: MvccSnapshot[applied={T|T < 7317399507541229568}]
I20260811 18:54:49.171553 1309 tablet_replica.cc:439] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } } }
I20260811 18:54:49.171878 1309 tablet_replica.cc:442] T 34e88f89e5d440598cd42348aab43ac6 P b963da116dd04d088ca1fc563c946946: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:54:49.174795 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.166387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53386 (local address 127.19.155.195:39697)
0811 18:54:49.166580 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.166598 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.166615 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:54:49.166724 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.166728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.166805 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.167020 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.167449 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.168697 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.170346 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.170975 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.171120 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.173473 (+ 2353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.174061 (+ 588us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.174229 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.174295 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.174376 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:54:49.191543 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.185443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:48099 (local address 127.19.155.193:40427)
0811 18:54:49.185626 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.185631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.186126 (+ 495us) server_negotiation.cc:407] Connection header received
0811 18:54:49.186362 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.186367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.186431 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.186529 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.187053 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.187844 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.189513 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.190017 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.190159 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.190658 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.190781 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.190881 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.191065 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.191161 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:54:49.191552 1379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.185343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40427 (local address 127.19.155.195:48099)
0811 18:54:49.186016 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:49.186032 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:49.186209 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:49.186546 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:49.186550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:49.186562 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:49.186855 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.186863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.188017 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.188024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.189309 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.189321 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.190202 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.190212 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.190428 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.190480 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.190887 (+ 407us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.190932 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:54:49.191034 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 18:54:49.191188 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":422,"threads_started":1}
I20260811 18:54:49.201721 976 raft_consensus.cc:1261] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Refusing update from remote peer b963da116dd04d088ca1fc563c946946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.202646 1309 consensus_queue.cc:1035] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.203073 778 raft_consensus.cc:1261] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Refusing update from remote peer b963da116dd04d088ca1fc563c946946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.203847 1309 consensus_queue.cc:1035] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.250084 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.232243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:60201 (local address 127.19.155.195:39697)
0811 18:54:49.232442 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.232449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.243596 (+ 11147us) server_negotiation.cc:407] Connection header received
0811 18:54:49.243862 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.243867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.243960 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.244064 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.245013 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.245807 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.247947 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.248621 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.248763 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.249405 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.249534 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.249632 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.249744 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.249821 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 18:54:49.250116 1384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.232563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:39697 (local address 127.19.155.193:60201)
0811 18:54:49.243466 (+ 10903us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:49.243492 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:49.243643 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:49.244464 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:49.244474 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:49.244488 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:54:49.244839 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.244851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.245946 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.245952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.247762 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:49.247778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.248849 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.248857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:49.249032 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.249108 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.249645 (+ 537us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.249655 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:54:49.249722 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 18:54:49.249830 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10673,"thread_start_us":10521,"threads_started":1}
I20260811 18:54:49.290382 516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.290701 516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42432:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.294451 516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Sending DeleteTablet for 3 replicas of tablet 3bd941d9d8634ed7ad245ab6e533618c
I20260811 18:54:49.295183 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43640
I20260811 18:54:49.295341 1156 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53372
I20260811 18:54:49.295468 1333 tablet_replica.cc:330] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: stopping tablet replica
I20260811 18:54:49.295642 1334 tablet_replica.cc:330] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: stopping tablet replica
I20260811 18:54:49.295691 1333 raft_consensus.cc:2229] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.295841 1334 raft_consensus.cc:2229] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:49.295897 1333 raft_consensus.cc:2258] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.296360 1334 raft_consensus.cc:2258] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.296864 947 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd941d9d8634ed7ad245ab6e533618c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46236
I20260811 18:54:49.297138 1333 ts_tablet_manager.cc:1905] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.297161 1335 tablet_replica.cc:330] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: stopping tablet replica
I20260811 18:54:49.297405 1335 raft_consensus.cc:2229] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.297648 1335 raft_consensus.cc:2258] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.298776 1334 ts_tablet_manager.cc:1905] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.298928 1335 ts_tablet_manager.cc:1905] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.305481 1335 ts_tablet_manager.cc:1918] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.305631 1335 log.cc:1196] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/3bd941d9d8634ed7ad245ab6e533618c
I20260811 18:54:49.306052 1335 ts_tablet_manager.cc:1939] T 3bd941d9d8634ed7ad245ab6e533618c P bfc2d8907d2140009c98b4a14492e75e: Deleting consensus metadata
I20260811 18:54:49.307036 500 catalog_manager.cc:4841] TS bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289): tablet 3bd941d9d8634ed7ad245ab6e533618c (table test-table [id=58b84dc5148b4d618fe93672b95e220d]) successfully deleted
I20260811 18:54:49.307344 1334 ts_tablet_manager.cc:1918] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.307509 1334 log.cc:1196] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/3bd941d9d8634ed7ad245ab6e533618c
I20260811 18:54:49.307938 1334 ts_tablet_manager.cc:1939] T 3bd941d9d8634ed7ad245ab6e533618c P b963da116dd04d088ca1fc563c946946: Deleting consensus metadata
I20260811 18:54:49.309108 496 catalog_manager.cc:4841] TS b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697): tablet 3bd941d9d8634ed7ad245ab6e533618c (table test-table [id=58b84dc5148b4d618fe93672b95e220d]) successfully deleted
I20260811 18:54:49.317098 1333 ts_tablet_manager.cc:1918] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.319049 1333 log.cc:1196] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/3bd941d9d8634ed7ad245ab6e533618c
I20260811 18:54:49.319593 1333 ts_tablet_manager.cc:1939] T 3bd941d9d8634ed7ad245ab6e533618c P 215f8d2906b24e939156ebea7a62e7cf: Deleting consensus metadata
I20260811 18:54:49.320880 499 catalog_manager.cc:4841] TS 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427): tablet 3bd941d9d8634ed7ad245ab6e533618c (table test-table [id=58b84dc5148b4d618fe93672b95e220d]) successfully deleted
Aug 11 18:54:49 dist-test-slave-1nl6 krb5kdc[451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:54:49 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:49 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:54:49.389912 1099 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:49.376208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.19.155.254:34369)
0811 18:54:49.376410 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.376418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.376956 (+ 538us) server_negotiation.cc:407] Connection header received
0811 18:54:49.377201 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.377208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.377343 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.377458 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:49.379377 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.380578 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.382590 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.383299 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.383401 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.389631 (+ 6230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42446: BlockingRecv error: recv got EOF from 127.0.0.1:42446 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 18:54:49 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM
I20260811 18:54:49.450032 1099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.420412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42450 (local address 127.19.155.254:34369)
0811 18:54:49.420595 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.420601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.431280 (+ 10679us) server_negotiation.cc:407] Connection header received
0811 18:54:49.431751 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.431758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.431861 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.431939 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:49.433915 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.435142 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.437134 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.437811 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.437906 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.443156 (+ 5250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:49.443164 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:49.443169 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:49.443211 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:49.446854 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:49.447697 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:49.447703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:49.447707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:49.447857 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:49.448283 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:49.448289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:49.448292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:49.448632 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:49.448907 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.449217 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.449448 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:54:49.454135 516 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:49.454944 516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:49.462822 734 tablet_service.cc:1467] Processing CreateTablet for tablet 3149eb8c6d3248348f19d0768826271e (DEFAULT_TABLE table=test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.463340 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3149eb8c6d3248348f19d0768826271e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.463500 947 tablet_service.cc:1467] Processing CreateTablet for tablet 3149eb8c6d3248348f19d0768826271e (DEFAULT_TABLE table=test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.463979 947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3149eb8c6d3248348f19d0768826271e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.467291 1156 tablet_service.cc:1467] Processing CreateTablet for tablet 3149eb8c6d3248348f19d0768826271e (DEFAULT_TABLE table=test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.467706 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3149eb8c6d3248348f19d0768826271e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.471624 1298 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Bootstrap starting.
I20260811 18:54:49.473343 1298 tablet_bootstrap.cc:654] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.478471 1297 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Bootstrap starting.
I20260811 18:54:49.480098 1297 tablet_bootstrap.cc:654] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.483583 1301 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Bootstrap starting.
I20260811 18:54:49.485266 1301 tablet_bootstrap.cc:654] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.486795 1298 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: No bootstrap required, opened a new log
I20260811 18:54:49.487022 1298 ts_tablet_manager.cc:1397] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
I20260811 18:54:49.487874 1298 raft_consensus.cc:348] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.488247 1298 raft_consensus.cc:374] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.488389 1298 raft_consensus.cc:729] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.488704 1298 consensus_queue.cc:260] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.491958 1298 ts_tablet_manager.cc:1428] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260811 18:54:49.496368 1301 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: No bootstrap required, opened a new log
I20260811 18:54:49.496526 1301 ts_tablet_manager.cc:1397] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260811 18:54:49.497282 1301 raft_consensus.cc:348] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.497542 1301 raft_consensus.cc:374] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.497641 1301 raft_consensus.cc:729] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b963da116dd04d088ca1fc563c946946, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.497913 1301 consensus_queue.cc:260] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.498881 1313 raft_consensus.cc:482] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:49.499082 1313 raft_consensus.cc:504] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.499778 1313 leader_election.cc:288] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289), b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697)
I20260811 18:54:49.500581 975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3149eb8c6d3248348f19d0768826271e" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e" is_pre_election: true
I20260811 18:54:49.501447 1196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3149eb8c6d3248348f19d0768826271e" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946" is_pre_election: true
W20260811 18:54:49.501457 660 leader_election.cc:341] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289): Illegal state: must be running to vote when last-logged opid is not known
I20260811 18:54:49.501685 1196 raft_consensus.cc:2454] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 0.
I20260811 18:54:49.502012 1297 tablet_bootstrap.cc:492] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: No bootstrap required, opened a new log
I20260811 18:54:49.502152 1297 ts_tablet_manager.cc:1397] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.004s
I20260811 18:54:49.502157 657 leader_election.cc:302] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946; no voters: bfc2d8907d2140009c98b4a14492e75e
I20260811 18:54:49.502671 1313 raft_consensus.cc:2781] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:49.502774 1313 raft_consensus.cc:482] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:49.502877 1313 raft_consensus.cc:3037] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.502880 1297 raft_consensus.cc:348] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.503145 1297 raft_consensus.cc:374] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.503228 1297 raft_consensus.cc:729] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc2d8907d2140009c98b4a14492e75e, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.503692 1301 ts_tablet_manager.cc:1428] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260811 18:54:49.505889 1297 consensus_queue.cc:260] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.506060 1313 raft_consensus.cc:504] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.507324 975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3149eb8c6d3248348f19d0768826271e" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e"
I20260811 18:54:49.507541 975 raft_consensus.cc:3037] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.508958 1196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3149eb8c6d3248348f19d0768826271e" candidate_uuid: "215f8d2906b24e939156ebea7a62e7cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b963da116dd04d088ca1fc563c946946"
I20260811 18:54:49.509160 1196 raft_consensus.cc:3037] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.510367 975 raft_consensus.cc:2454] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:49.511998 660 leader_election.cc:302] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, bfc2d8907d2140009c98b4a14492e75e; no voters:
I20260811 18:54:49.512305 1328 raft_consensus.cc:2781] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:49.512373 1196 raft_consensus.cc:2454] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215f8d2906b24e939156ebea7a62e7cf in term 1.
I20260811 18:54:49.512462 1328 raft_consensus.cc:686] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 1 LEADER]: Becoming Leader. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Running, Role: LEADER
I20260811 18:54:49.512741 1328 consensus_queue.cc:237] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.512982 1313 leader_election.cc:288] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [CANDIDATE]: Term 1 election: Requested vote from peers bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289), b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697)
I20260811 18:54:49.515290 516 catalog_manager.cc:5495] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193). New cstate: current_term: 1 leader_uuid: "215f8d2906b24e939156ebea7a62e7cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } health_report { overall_health: UNKNOWN } } }
I20260811 18:54:49.516602 1297 ts_tablet_manager.cc:1428] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260811 18:54:49.540899 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.534420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43654 (local address 127.19.155.193:40427)
0811 18:54:49.534654 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.534661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.534681 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:49.534922 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.534928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.535018 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.535114 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.535551 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.536784 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.538691 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.539373 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.539511 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.540027 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.540176 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.540411 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.540489 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.540587 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 18:54:49.543934 1196 raft_consensus.cc:1261] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.543933 975 raft_consensus.cc:1261] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Refusing update from remote peer 215f8d2906b24e939156ebea7a62e7cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.544692 1328 consensus_queue.cc:1035] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.545229 1308 consensus_queue.cc:1035] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.572805 516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.573052 516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.576540 516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Sending DeleteTablet for 3 replicas of tablet 3149eb8c6d3248348f19d0768826271e
I20260811 18:54:49.577291 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 3149eb8c6d3248348f19d0768826271e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43640
I20260811 18:54:49.577466 947 tablet_service.cc:1514] Processing DeleteTablet for tablet 3149eb8c6d3248348f19d0768826271e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46236
I20260811 18:54:49.577576 1333 tablet_replica.cc:330] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: stopping tablet replica
I20260811 18:54:49.577735 1335 tablet_replica.cc:330] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: stopping tablet replica
I20260811 18:54:49.577911 1335 raft_consensus.cc:2229] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.578001 1333 raft_consensus.cc:2229] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:49.578154 1335 raft_consensus.cc:2258] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.578334 1333 raft_consensus.cc:2258] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.579190 1156 tablet_service.cc:1514] Processing DeleteTablet for tablet 3149eb8c6d3248348f19d0768826271e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53372
I20260811 18:54:49.579470 1334 tablet_replica.cc:330] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: stopping tablet replica
I20260811 18:54:49.579597 1333 ts_tablet_manager.cc:1905] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.579648 1334 raft_consensus.cc:2229] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.579875 1334 raft_consensus.cc:2258] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.580747 517 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:49.581398 517 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:49.586086 1333 ts_tablet_manager.cc:1918] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:49.586239 1333 log.cc:1196] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/3149eb8c6d3248348f19d0768826271e
I20260811 18:54:49.586711 1333 ts_tablet_manager.cc:1939] T 3149eb8c6d3248348f19d0768826271e P 215f8d2906b24e939156ebea7a62e7cf: Deleting consensus metadata
I20260811 18:54:49.588258 1334 ts_tablet_manager.cc:1905] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.588987 947 tablet_service.cc:1467] Processing CreateTablet for tablet 57b93ce96e714b648f65ad6910e0875d (DEFAULT_TABLE table=test-table [id=c57d526e33654981838669a1c6ea4c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.589428 947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b93ce96e714b648f65ad6910e0875d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.591257 1156 tablet_service.cc:1467] Processing CreateTablet for tablet 57b93ce96e714b648f65ad6910e0875d (DEFAULT_TABLE table=test-table [id=c57d526e33654981838669a1c6ea4c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.591667 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b93ce96e714b648f65ad6910e0875d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.595734 734 tablet_service.cc:1467] Processing CreateTablet for tablet 57b93ce96e714b648f65ad6910e0875d (DEFAULT_TABLE table=test-table [id=c57d526e33654981838669a1c6ea4c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:49.596185 734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b93ce96e714b648f65ad6910e0875d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:49.604418 1334 ts_tablet_manager.cc:1918] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:49.604790 1298 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Bootstrap starting.
I20260811 18:54:49.606066 1297 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Bootstrap starting.
I20260811 18:54:49.606752 1298 tablet_bootstrap.cc:654] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.607739 1297 tablet_bootstrap.cc:654] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.610703 1301 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Bootstrap starting.
I20260811 18:54:49.610757 1334 log.cc:1196] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/3149eb8c6d3248348f19d0768826271e
I20260811 18:54:49.611697 1334 ts_tablet_manager.cc:1939] T 3149eb8c6d3248348f19d0768826271e P b963da116dd04d088ca1fc563c946946: Deleting consensus metadata
I20260811 18:54:49.612474 1301 tablet_bootstrap.cc:654] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:49.613081 499 catalog_manager.cc:4841] TS 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427): tablet 3149eb8c6d3248348f19d0768826271e (table test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]) successfully deleted
I20260811 18:54:49.615823 1335 ts_tablet_manager.cc:1905] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.616425 1297 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: No bootstrap required, opened a new log
I20260811 18:54:49.616627 1297 ts_tablet_manager.cc:1397] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260811 18:54:49.617697 1297 raft_consensus.cc:348] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.618036 1297 raft_consensus.cc:374] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.618129 1297 raft_consensus.cc:729] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc2d8907d2140009c98b4a14492e75e, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.618466 1297 consensus_queue.cc:260] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.619125 1297 ts_tablet_manager.cc:1428] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 18:54:49.621682 496 catalog_manager.cc:4841] TS b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697): tablet 3149eb8c6d3248348f19d0768826271e (table test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]) successfully deleted
I20260811 18:54:49.629400 1298 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: No bootstrap required, opened a new log
I20260811 18:54:49.630079 1298 ts_tablet_manager.cc:1397] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.012s
I20260811 18:54:49.631040 1298 raft_consensus.cc:348] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.631265 1335 ts_tablet_manager.cc:1918] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:49.631407 1335 log.cc:1196] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/3149eb8c6d3248348f19d0768826271e
I20260811 18:54:49.632002 1335 ts_tablet_manager.cc:1939] T 3149eb8c6d3248348f19d0768826271e P bfc2d8907d2140009c98b4a14492e75e: Deleting consensus metadata
I20260811 18:54:49.632522 1298 raft_consensus.cc:374] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.632827 1298 raft_consensus.cc:729] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215f8d2906b24e939156ebea7a62e7cf, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.633504 500 catalog_manager.cc:4841] TS bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289): tablet 3149eb8c6d3248348f19d0768826271e (table test-table [id=76d3c6432a0d4746931bf4ff437d3cc7]) successfully deleted
I20260811 18:54:49.633417 1298 consensus_queue.cc:260] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.635190 1298 ts_tablet_manager.cc:1428] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:54:49.640539 1301 tablet_bootstrap.cc:492] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: No bootstrap required, opened a new log
I20260811 18:54:49.640744 1301 ts_tablet_manager.cc:1397] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.005s
I20260811 18:54:49.641656 1301 raft_consensus.cc:348] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.641950 1301 raft_consensus.cc:374] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:49.642036 1301 raft_consensus.cc:729] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b963da116dd04d088ca1fc563c946946, State: Initialized, Role: FOLLOWER
I20260811 18:54:49.642323 1301 consensus_queue.cc:260] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.646451 1301 ts_tablet_manager.cc:1428] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260811 18:54:49.757916 1309 raft_consensus.cc:482] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:49.758224 1309 raft_consensus.cc:504] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.759155 1309 leader_election.cc:288] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:49.759732 778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b93ce96e714b648f65ad6910e0875d" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215f8d2906b24e939156ebea7a62e7cf" is_pre_election: true
I20260811 18:54:49.759989 778 raft_consensus.cc:2454] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 0.
I20260811 18:54:49.760001 975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b93ce96e714b648f65ad6910e0875d" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e" is_pre_election: true
I20260811 18:54:49.760303 975 raft_consensus.cc:2454] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 0.
I20260811 18:54:49.760663 1085 leader_election.cc:302] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946; no voters:
I20260811 18:54:49.761097 1309 raft_consensus.cc:2781] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:49.761219 1309 raft_consensus.cc:482] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:49.761337 1309 raft_consensus.cc:3037] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.764825 1309 raft_consensus.cc:504] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.765556 1309 leader_election.cc:288] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 election: Requested vote from peers 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427), bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289)
I20260811 18:54:49.766217 778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b93ce96e714b648f65ad6910e0875d" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215f8d2906b24e939156ebea7a62e7cf"
I20260811 18:54:49.766419 778 raft_consensus.cc:3037] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.766865 975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b93ce96e714b648f65ad6910e0875d" candidate_uuid: "b963da116dd04d088ca1fc563c946946" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfc2d8907d2140009c98b4a14492e75e"
I20260811 18:54:49.767149 975 raft_consensus.cc:3037] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:49.769688 778 raft_consensus.cc:2454] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 1.
I20260811 18:54:49.770470 1085 leader_election.cc:302] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215f8d2906b24e939156ebea7a62e7cf, b963da116dd04d088ca1fc563c946946; no voters:
I20260811 18:54:49.770959 975 raft_consensus.cc:2454] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b963da116dd04d088ca1fc563c946946 in term 1.
I20260811 18:54:49.771642 1309 raft_consensus.cc:2781] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:49.772075 1309 raft_consensus.cc:686] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 1 LEADER]: Becoming Leader. State: Replica: b963da116dd04d088ca1fc563c946946, State: Running, Role: LEADER
I20260811 18:54:49.772708 1309 consensus_queue.cc:237] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } }
I20260811 18:54:49.776484 516 catalog_manager.cc:5495] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 reported cstate change: term changed from 0 to 1, leader changed from <none> to b963da116dd04d088ca1fc563c946946 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "b963da116dd04d088ca1fc563c946946" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b963da116dd04d088ca1fc563c946946" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 39697 } health_report { overall_health: HEALTHY } } }
I20260811 18:54:49.831559 1431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.824812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53390 (local address 127.19.155.195:39697)
0811 18:54:49.825400 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.825407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.825425 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:54:49.825485 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.825490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.825568 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.825685 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:49.826093 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.827313 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.829248 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.829946 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.830065 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.830649 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:49.830792 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:49.830878 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.831084 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.831166 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":561,"threads_started":1}
I20260811 18:54:49.841361 778 raft_consensus.cc:1261] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Refusing update from remote peer b963da116dd04d088ca1fc563c946946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.841784 975 raft_consensus.cc:1261] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Refusing update from remote peer b963da116dd04d088ca1fc563c946946: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:49.842338 1309 consensus_queue.cc:1035] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215f8d2906b24e939156ebea7a62e7cf" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.842602 1427 consensus_queue.cc:1035] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc2d8907d2140009c98b4a14492e75e" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:49.919701 516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.919951 516 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:49.922622 516 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d6862f5186d4cabaed2747a0a513734: Sending DeleteTablet for 3 replicas of tablet 57b93ce96e714b648f65ad6910e0875d
I20260811 18:54:49.923297 734 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b93ce96e714b648f65ad6910e0875d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43640
I20260811 18:54:49.923367 947 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b93ce96e714b648f65ad6910e0875d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46236
I20260811 18:54:49.923491 1156 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b93ce96e714b648f65ad6910e0875d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:49 UTC) from {username='oryx', principal='oryx/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:53372
I20260811 18:54:49.923709 1335 tablet_replica.cc:330] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: stopping tablet replica
I20260811 18:54:49.923789 1334 tablet_replica.cc:330] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: stopping tablet replica
I20260811 18:54:49.923787 1333 tablet_replica.cc:330] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: stopping tablet replica
I20260811 18:54:49.923971 1335 raft_consensus.cc:2229] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.923995 1333 raft_consensus.cc:2229] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:49.923990 1334 raft_consensus.cc:2229] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:54:49.924153 1333 raft_consensus.cc:2258] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.924232 1335 raft_consensus.cc:2258] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.924291 1334 raft_consensus.cc:2258] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:49.925421 1334 ts_tablet_manager.cc:1905] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.925467 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 630
I20260811 18:54:49.925812 1333 ts_tablet_manager.cc:1905] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.926777 1335 ts_tablet_manager.cc:1905] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:49.930526 1333 ts_tablet_manager.cc:1918] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.930696 1333 log.cc:1196] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/57b93ce96e714b648f65ad6910e0875d
I20260811 18:54:49.931331 1333 ts_tablet_manager.cc:1939] T 57b93ce96e714b648f65ad6910e0875d P 215f8d2906b24e939156ebea7a62e7cf: Deleting consensus metadata
I20260811 18:54:49.932590 499 catalog_manager.cc:4841] TS 215f8d2906b24e939156ebea7a62e7cf (127.19.155.193:40427): tablet 57b93ce96e714b648f65ad6910e0875d (table test-table [id=c57d526e33654981838669a1c6ea4c23]) successfully deleted
I20260811 18:54:49.932893 1334 ts_tablet_manager.cc:1918] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.933048 1334 log.cc:1196] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/57b93ce96e714b648f65ad6910e0875d
I20260811 18:54:49.933388 1335 ts_tablet_manager.cc:1918] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:54:49.933482 1334 ts_tablet_manager.cc:1939] T 57b93ce96e714b648f65ad6910e0875d P b963da116dd04d088ca1fc563c946946: Deleting consensus metadata
I20260811 18:54:49.933557 1335 log.cc:1196] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/57b93ce96e714b648f65ad6910e0875d
I20260811 18:54:49.933947 1335 ts_tablet_manager.cc:1939] T 57b93ce96e714b648f65ad6910e0875d P bfc2d8907d2140009c98b4a14492e75e: Deleting consensus metadata
I20260811 18:54:49.934662 496 catalog_manager.cc:4841] TS b963da116dd04d088ca1fc563c946946 (127.19.155.195:39697): tablet 57b93ce96e714b648f65ad6910e0875d (table test-table [id=c57d526e33654981838669a1c6ea4c23]) successfully deleted
I20260811 18:54:49.935047 500 catalog_manager.cc:4841] TS bfc2d8907d2140009c98b4a14492e75e (127.19.155.194:40289): tablet 57b93ce96e714b648f65ad6910e0875d (table test-table [id=c57d526e33654981838669a1c6ea4c23]) successfully deleted
Aug 11 18:54:49 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.193@KRBTEST.COM
I20260811 18:54:49.946842 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:49.931044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43658 (local address 127.19.155.193:40427)
0811 18:54:49.931201 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:49.931221 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:49.932863 (+ 1642us) server_negotiation.cc:407] Connection header received
0811 18:54:49.933108 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:49.933113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:49.933195 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:49.933322 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:49.934958 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.935772 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.936917 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:49.937319 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:49.937422 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:49.941392 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:49.941407 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:49.941426 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:49.941456 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:49.944097 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:49.944830 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:49.944838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:49.944841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:49.944963 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:49.945319 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:49.945323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:49.945326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:49.945713 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:49.946045 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:49.946284 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 18:54:49.946505 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:54:49.947543 840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:50.093365 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 630
I20260811 18:54:50.130458 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 857
Aug 11 18:54:50 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.194@KRBTEST.COM
I20260811 18:54:50.147842 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:50.131299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46246 (local address 127.19.155.194:40289)
0811 18:54:50.131726 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:50.131731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:50.131748 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:54:50.131806 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:50.131809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:50.131873 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:50.131963 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:50.133174 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:50.133961 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:50.135326 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:50.135769 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:50.135864 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:50.141416 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:50.141435 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:50.141460 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:50.141503 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:50.145466 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:50.146104 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:50.146111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:50.146113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:50.146261 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:50.146564 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:50.146567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:50.146569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:50.146959 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:50.147181 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:50.147428 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 18:54:50.147580 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":221,"threads_started":1}
I20260811 18:54:50.148473 1047 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:50.245471 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 857
I20260811 18:54:50.275786 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 1060
Aug 11 18:54:50 dist-test-slave-1nl6 krb5kdc[451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.155.195@KRBTEST.COM
I20260811 18:54:50.291479 1431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:50.276645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.19.155.195:39697)
0811 18:54:50.276874 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:50.276883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:50.276907 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:54:50.277162 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:50.277167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:50.277250 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:50.277384 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:50.278755 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:50.279536 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:50.280793 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:50.281197 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:50.281345 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:50.285845 (+ 4500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:50.285860 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:50.285880 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:50.285920 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:50.288762 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:50.289384 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:50.289391 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:50.289393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:50.289523 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:50.289951 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:50.289955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:50.289957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:50.290321 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:50.290567 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:50.290804 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 18:54:50.291220 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 18:54:50.292168 1252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:50.421630 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 1060
I20260811 18:54:50.455164 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 473
I20260811 18:54:50.456387 581 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:50.572469 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 473
2026-08-11T18:54:50Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (5949 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:50 dist-test-slave-1nl6 krb5kdc[1453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:50 dist-test-slave-1nl6 krb5kdc[1453](info): set up 2 sockets
Aug 11 18:54:50 dist-test-slave-1nl6 krb5kdc[1453](info): commencing operation
krb5kdc: starting...
W20260811 18:54:51.894804 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.002s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:52 dist-test-slave-1nl6 krb5kdc[1453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:52.143168 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:43695
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:43695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:52.500027 1467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:52.500372 1467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:52.500554 1467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:52.507800 1467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:52.507941 1467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:52.508028 1467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:52.508113 1467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:52.508184 1467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:52.518194 1467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:43695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:43695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:52.519387 1467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:52.520709 1467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:52.532732 1481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:52.532872 1478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:52.532699 1484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:52.533351 1467 server_base.cc:1034] running on GCE node
I20260811 18:54:52.534189 1467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:52.535584 1467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:52.536823 1467 hybrid_clock.cc:648] HybridClock initialized: now 1786474492536784 us; error 24 us; skew 500 ppm
I20260811 18:54:52.537189 1467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T18:54:52Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2022 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:52 dist-test-slave-1nl6 krb5kdc[1492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:52 dist-test-slave-1nl6 krb5kdc[1492](info): set up 2 sockets
Aug 11 18:54:52 dist-test-slave-1nl6 krb5kdc[1492](info): commencing operation
krb5kdc: starting...
W20260811 18:54:53.933822 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.002s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:54:54 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:54:54.198957 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46057
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:54.530638 1513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:54.531049 1513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:54.531230 1513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:54.538663 1513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:54.538826 1513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:54.538969 1513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:54.539081 1513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:54.539165 1513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:54.548882 1513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:54.550206 1513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:54.551574 1513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:54.563625 1522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:54.563727 1524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:54.563748 1527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:54.564731 1513 server_base.cc:1034] running on GCE node
I20260811 18:54:54.565434 1513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:54.566721 1513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:54.567946 1513 hybrid_clock.cc:648] HybridClock initialized: now 1786474494567878 us; error 48 us; skew 500 ppm
I20260811 18:54:54.568264 1513 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:54 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:54.571362 1513 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:54.572880 1513 webserver.cc:460] Webserver started at http://127.19.155.254:36153/ using document root <none> and password file <none>
I20260811 18:54:54.573526 1513 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:54.573629 1513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:54.573889 1513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:54.576967 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "0fae40e08bf84be9878d77d363ad53fe"
format_stamp: "Formatted at 2026-08-11 18:54:54 on dist-test-slave-1nl6"
server_key: "47f4506105ebbeba2e0fb54c14cd92c9"
server_key_iv: "ecdb972bb2d95dbe8c1940d98cb5029a"
server_key_version: "encryptionkey@0"
I20260811 18:54:54.577687 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "0fae40e08bf84be9878d77d363ad53fe"
format_stamp: "Formatted at 2026-08-11 18:54:54 on dist-test-slave-1nl6"
server_key: "47f4506105ebbeba2e0fb54c14cd92c9"
server_key_iv: "ecdb972bb2d95dbe8c1940d98cb5029a"
server_key_version: "encryptionkey@0"
I20260811 18:54:54.582841 1513 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:54:54.586203 1536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:54.587587 1513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:54.587772 1513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "0fae40e08bf84be9878d77d363ad53fe"
format_stamp: "Formatted at 2026-08-11 18:54:54 on dist-test-slave-1nl6"
server_key: "47f4506105ebbeba2e0fb54c14cd92c9"
server_key_iv: "ecdb972bb2d95dbe8c1940d98cb5029a"
server_key_version: "encryptionkey@0"
I20260811 18:54:54.587973 1513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:54.599251 1513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:54.603027 1513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:54.603338 1513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:54.621927 1513 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46057
I20260811 18:54:54.621929 1615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46057 every 8 connection(s)
I20260811 18:54:54.623479 1513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:54.627467 1616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:54.632421 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 1513
I20260811 18:54:54.632653 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:54:54.633363 20079 external_mini_cluster.cc:1428] Setting key 6dde7a4b2fc1949004259f663ee7b8e3
I20260811 18:54:54.639878 1616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Bootstrap starting.
I20260811 18:54:54.643754 1616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:54.644814 1616 log.cc:824] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:54.647889 1616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: No bootstrap required, opened a new log
Aug 11 18:54:54 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:54.658329 1616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:54.658787 1616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:54.658917 1616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fae40e08bf84be9878d77d363ad53fe, State: Initialized, Role: FOLLOWER
I20260811 18:54:54.659113 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:54.635590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44262 (local address 127.19.155.254:46057)
0811 18:54:54.636563 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:54.636580 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:54.636642 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:54:54.639049 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:54.639077 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:54.639573 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:54.640032 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:54.641552 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:54.643615 (+ 2063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:54.645026 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:54.645931 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:54.646062 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:54.650229 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:54.650240 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:54.650259 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:54.650310 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:54.654447 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:54.655215 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:54.655224 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:54.655232 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:54.655447 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:54.655851 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:54.655856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:54.655859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:54.656591 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:54.656910 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:54.657247 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 18:54:54.657683 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":439,"threads_started":1}
I20260811 18:54:54.659590 1616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:54.659870 1616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:54.660027 1616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:54.660218 1616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:54.663278 1616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:54.663829 1616 leader_election.cc:302] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fae40e08bf84be9878d77d363ad53fe; no voters:
I20260811 18:54:54.664551 1616 leader_election.cc:288] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:54.664696 1621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:54.665503 1621 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 LEADER]: Becoming Leader. State: Replica: 0fae40e08bf84be9878d77d363ad53fe, State: Running, Role: LEADER
I20260811 18:54:54.666081 1621 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:54.666765 1616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:54.669502 1622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fae40e08bf84be9878d77d363ad53fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } } }
I20260811 18:54:54.669940 1622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:54.669479 1623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fae40e08bf84be9878d77d363ad53fe. Latest consensus state: current_term: 1 leader_uuid: "0fae40e08bf84be9878d77d363ad53fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } } }
I20260811 18:54:54.670948 1623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:54.676928 1628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:54.681666 1628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:54.691385 1628 catalog_manager.cc:1347] Generated new cluster ID: 5856a6526c8b4b4595251502df15dae6
I20260811 18:54:54.691510 1628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:54.713997 1628 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:54.716005 1628 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:54.731418 1628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Generated new TSK 0
I20260811 18:54:54.732398 1628 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:54:54.810536 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:55.171648 1654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:55.172077 1654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:55.172315 1654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:55.180612 1654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:55.180747 1654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:55.180938 1654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:55.191455 1654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:55.192777 1654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:55.194079 1654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:55.207127 1660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:55.207094 1663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:55.207319 1659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:55.207954 1654 server_base.cc:1034] running on GCE node
I20260811 18:54:55.208498 1654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:55.209342 1654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:55.210589 1654 hybrid_clock.cc:648] HybridClock initialized: now 1786474495210531 us; error 43 us; skew 500 ppm
I20260811 18:54:55.210970 1654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:55 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474495, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:55.214138 1654 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:54:55.215638 1654 webserver.cc:460] Webserver started at http://127.19.155.193:34589/ using document root <none> and password file <none>
I20260811 18:54:55.216338 1654 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:55.216500 1654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:55.216828 1654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:55.219772 1654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "6faefcd6c86f4f93979cf2096b2cb117"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "b2ba52e75a6c862e795fdbcda518828d"
server_key_iv: "8326b4c310c2d43e74823a784a5830cb"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.220664 1654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "6faefcd6c86f4f93979cf2096b2cb117"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "b2ba52e75a6c862e795fdbcda518828d"
server_key_iv: "8326b4c310c2d43e74823a784a5830cb"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.225827 1654 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:55.229255 1672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.230459 1654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 18:54:55.230643 1654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "6faefcd6c86f4f93979cf2096b2cb117"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "b2ba52e75a6c862e795fdbcda518828d"
server_key_iv: "8326b4c310c2d43e74823a784a5830cb"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.230854 1654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:55.251705 1654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:55.255686 1654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:55.255998 1654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:55.256980 1654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:55.258435 1654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:55.258553 1654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.258710 1654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:55.258795 1654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.292855 1654 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36805
I20260811 18:54:55.292887 1842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36805 every 8 connection(s)
I20260811 18:54:55.294165 1654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:55.294842 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 1654
I20260811 18:54:55.295114 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:55.295979 20079 external_mini_cluster.cc:1428] Setting key 989078cd7046ac045375f1e78f32a8a7
Aug 11 18:54:55 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474495, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:55.319623 1845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:55.297049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:44817 (local address 127.19.155.254:46057)
0811 18:54:55.297561 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:55.297567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:55.299747 (+ 2180us) server_negotiation.cc:407] Connection header received
0811 18:54:55.302540 (+ 2793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:55.302544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:55.302607 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:55.302698 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:55.304805 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.305535 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.308040 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.308464 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.308589 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:55.312340 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:55.312349 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:55.312357 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:55.312404 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:55.316175 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:55.316903 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:55.316912 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:55.316918 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:55.317073 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:55.317507 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:55.317515 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:55.317521 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:55.317953 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:55.318150 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:55.318783 (+ 633us) server_negotiation.cc:299] Negotiation successful
0811 18:54:55.319099 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":254,"threads_started":1}
I20260811 18:54:55.320178 1846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:55.297706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:44817)
0811 18:54:55.299568 (+ 1862us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:55.299619 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:55.302260 (+ 2641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:55.302994 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:55.303007 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:55.303798 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:55.304607 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:55.304636 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.305713 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.305721 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:55.307859 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:55.307878 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.308724 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.308733 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:55.309054 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:55.309865 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:55.309888 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:55.312056 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:55.316326 (+ 4270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:55.316332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:55.316344 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:55.316748 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:55.317183 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:55.317186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:55.317189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:55.317363 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:55.318084 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:55.318089 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:55.318385 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 18:54:55.318600 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 18:54:55.319056 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1519,"thread_start_us":1261,"threads_started":1}
I20260811 18:54:55.321823 1843 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46057
I20260811 18:54:55.322201 1843 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:55.322980 1843 heartbeater.cc:511] Master 127.19.155.254:46057 requested a full tablet report, sending...
I20260811 18:54:55.325121 1561 ts_manager.cc:194] Registered new tserver with Master: 6faefcd6c86f4f93979cf2096b2cb117 (127.19.155.193:36805)
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:54:55.326655 1561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:44817
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:54:55.362389 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:55.702867 1850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:55.703197 1850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:55.703374 1850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:55.710286 1850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:55.710443 1850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:55.710638 1850 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:55.719900 1850 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:55.721148 1850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:55.722457 1850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:55.735916 1858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:55.736003 1857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:55.735970 1860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:55.737126 1850 server_base.cc:1034] running on GCE node
I20260811 18:54:55.737843 1850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:55.738749 1850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:55.739970 1850 hybrid_clock.cc:648] HybridClock initialized: now 1786474495739909 us; error 48 us; skew 500 ppm
I20260811 18:54:55.740302 1850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:55 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474495, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:55.743397 1850 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:54:55.744799 1850 webserver.cc:460] Webserver started at http://127.19.155.194:39377/ using document root <none> and password file <none>
I20260811 18:54:55.745496 1850 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:55.745640 1850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:55.745977 1850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:55.748867 1850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "764de55760644451a75b4aa4bb3a9355"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "36644ec3b5b26f69b20aeb992d3865db"
server_key_iv: "2e69cdd27ec548bc680cedc6b733472e"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.749694 1850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "764de55760644451a75b4aa4bb3a9355"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "36644ec3b5b26f69b20aeb992d3865db"
server_key_iv: "2e69cdd27ec548bc680cedc6b733472e"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.754832 1850 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 18:54:55.758275 1869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.759687 1850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:55.759860 1850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "764de55760644451a75b4aa4bb3a9355"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "36644ec3b5b26f69b20aeb992d3865db"
server_key_iv: "2e69cdd27ec548bc680cedc6b733472e"
server_key_version: "encryptionkey@0"
I20260811 18:54:55.760047 1850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:55.778553 1850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:55.782438 1850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:55.782737 1850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:55.783902 1850 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:55.785296 1850 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:55.785368 1850 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.785523 1850 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:55.785583 1850 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:55.822160 1850 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39633
I20260811 18:54:55.822201 2042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39633 every 8 connection(s)
I20260811 18:54:55.823753 1850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:55.828608 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 1850
I20260811 18:54:55.828792 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:55.829257 20079 external_mini_cluster.cc:1428] Setting key 1c4e64e99f9845439820c1b307124ff1
Aug 11 18:54:55 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474495, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:55.847159 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:55.826580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:56587 (local address 127.19.155.254:46057)
0811 18:54:55.827100 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:55.827106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:55.828165 (+ 1059us) server_negotiation.cc:407] Connection header received
0811 18:54:55.830268 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:55.830274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:55.830357 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:55.830471 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:55.832436 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.833637 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.835462 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.836187 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.836339 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:55.840274 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:55.840282 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:55.840290 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:55.840342 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:55.843707 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:55.844680 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:55.844683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:55.844686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:55.844807 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:55.845310 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:55.845313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:55.845315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:55.845566 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:55.845684 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:55.846573 (+ 889us) server_negotiation.cc:299] Negotiation successful
0811 18:54:55.846822 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":245,"threads_started":1}
I20260811 18:54:55.848618 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:55.827226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:56587)
0811 18:54:55.827986 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:55.828026 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:55.829951 (+ 1925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:55.830802 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:55.830814 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:55.831616 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:55.832244 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:55.832263 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.833809 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.833813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:55.835266 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:55.835279 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:55.836452 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:55.836458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:55.836687 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:55.837432 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:55.837461 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:55.840015 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:55.843853 (+ 3838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:55.843865 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:55.843885 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:55.844548 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:55.844925 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:55.844933 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:55.844939 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:55.845188 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:55.845693 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:55.845704 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:55.846164 (+ 460us) client_negotiation.cc:769] Sending connection context
0811 18:54:55.846477 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 18:54:55.847096 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":290,"threads_started":1}
I20260811 18:54:55.850152 2044 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46057
I20260811 18:54:55.850464 2044 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:55.851265 2044 heartbeater.cc:511] Master 127.19.155.254:46057 requested a full tablet report, sending...
I20260811 18:54:55.852890 1561 ts_manager.cc:194] Registered new tserver with Master: 764de55760644451a75b4aa4bb3a9355 (127.19.155.194:39633)
I20260811 18:54:55.853737 1561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:56587
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:54:55.893642 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:56.225898 2054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:56.226153 2054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:56.226306 2054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:56.233397 2054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:56.233493 2054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:56.233642 2054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:56.242911 2054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:56.244112 2054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:56.245366 2054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:56.258370 2062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:56.258412 2061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:56.258818 2064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:56.259228 2054 server_base.cc:1034] running on GCE node
I20260811 18:54:56.259908 2054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:56.260785 2054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:56.262036 2054 hybrid_clock.cc:648] HybridClock initialized: now 1786474496261988 us; error 49 us; skew 500 ppm
I20260811 18:54:56.262367 2054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:56 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474496, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:56.265802 2054 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:54:56.267513 2054 webserver.cc:460] Webserver started at http://127.19.155.195:41319/ using document root <none> and password file <none>
I20260811 18:54:56.268239 2054 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:56.268388 2054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:56.268710 2054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:54:56.271677 2054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "8c40567819144df7b38239adba3c4639"
format_stamp: "Formatted at 2026-08-11 18:54:56 on dist-test-slave-1nl6"
server_key: "a07781d749e3689ff694c633cb97df2c"
server_key_iv: "0783585c52da7fee3693d866bbe07853"
server_key_version: "encryptionkey@0"
I20260811 18:54:56.272508 2054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "8c40567819144df7b38239adba3c4639"
format_stamp: "Formatted at 2026-08-11 18:54:56 on dist-test-slave-1nl6"
server_key: "a07781d749e3689ff694c633cb97df2c"
server_key_iv: "0783585c52da7fee3693d866bbe07853"
server_key_version: "encryptionkey@0"
I20260811 18:54:56.277643 2054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:54:56.281036 2076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:56.282284 2054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:56.282486 2054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "8c40567819144df7b38239adba3c4639"
format_stamp: "Formatted at 2026-08-11 18:54:56 on dist-test-slave-1nl6"
server_key: "a07781d749e3689ff694c633cb97df2c"
server_key_iv: "0783585c52da7fee3693d866bbe07853"
server_key_version: "encryptionkey@0"
I20260811 18:54:56.282682 2054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:56.312850 2054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:56.317428 2054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:56.317739 2054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:56.318708 2054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:56.320135 2054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:56.320254 2054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:56.320430 2054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:56.320525 2054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:56.329579 1843 heartbeater.cc:503] Master 127.19.155.254:46057 was elected leader, sending a full tablet report...
I20260811 18:54:56.354852 2054 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:33893
I20260811 18:54:56.354940 2246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:33893 every 8 connection(s)
I20260811 18:54:56.356189 2054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:56.357512 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 2054
I20260811 18:54:56.357684 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:56.358232 20079 external_mini_cluster.cc:1428] Setting key 8a5dabfd63c942b5dcbeec19e1bdf506
Aug 11 18:54:56 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474496, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:54:56.376905 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:56.358968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:41345 (local address 127.19.155.254:46057)
0811 18:54:56.359460 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:56.359465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:56.360503 (+ 1038us) server_negotiation.cc:407] Connection header received
0811 18:54:56.362563 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:56.362568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:56.362661 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:56.362804 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:56.364414 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.365193 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.366825 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.367337 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.367511 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:56.370699 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:56.370705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:56.370710 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:56.370758 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:56.374156 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.374820 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.374823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.374826 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.374999 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.375449 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.375452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.375454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.375711 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:56.375820 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:56.376460 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 18:54:56.376630 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":251,"threads_started":1}
I20260811 18:54:56.378010 2252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:56.359524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:41345)
0811 18:54:56.360355 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:56.360389 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:56.362303 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:56.363047 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:56.363054 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:56.363534 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:56.364243 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:56.364263 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.365366 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.365370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:56.366672 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:56.366685 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.367594 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.367602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:56.367847 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:56.368483 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:56.368503 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:56.370504 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:56.374307 (+ 3803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:56.374319 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:56.374330 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:56.374715 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:56.375098 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:56.375101 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:56.375104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:56.375351 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:56.375824 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:56.375830 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:56.376113 (+ 283us) client_negotiation.cc:769] Sending connection context
0811 18:54:56.376372 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 18:54:56.376840 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":343,"threads_started":1}
I20260811 18:54:56.379320 2248 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46057
I20260811 18:54:56.379624 2248 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:56.380292 2248 heartbeater.cc:511] Master 127.19.155.254:46057 requested a full tablet report, sending...
I20260811 18:54:56.381665 1561 ts_manager.cc:194] Registered new tserver with Master: 8c40567819144df7b38239adba3c4639 (127.19.155.195:33893)
I20260811 18:54:56.382432 1561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:41345
I20260811 18:54:56.386255 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
Entry for principal oryx/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab.
WARNING: no policy specified for oryx/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
Entry for principal oryx/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab.
WARNING: no policy specified for oryx/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
Entry for principal oryx/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab.
I20260811 18:54:56.553750 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 1654
Aug 11 18:54:56 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:54:56.570319 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:56.554993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.19.155.193:36805)
0811 18:54:56.555640 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:56.555648 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:56.555679 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:54:56.555857 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:56.555865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:56.556098 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:56.556253 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:56.557583 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.558574 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.559850 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.560529 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.560627 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:56.564624 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:56.564635 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:56.564651 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:56.564681 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:56.567752 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.568479 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.568487 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.568489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.568612 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.568933 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.568936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.568938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.569271 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:56.569507 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:56.569722 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 18:54:56.569914 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":314,"threads_started":1}
I20260811 18:54:56.571694 1836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:56.655488 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 1654
I20260811 18:54:56.682438 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 1850
Aug 11 18:54:56 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:54:56.699102 2265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:56.683397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36970 (local address 127.19.155.194:39633)
0811 18:54:56.684069 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:56.684077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:56.684109 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:54:56.684183 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:56.684190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:56.684399 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:56.684536 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:56.685961 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.687278 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.688520 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.689099 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.689196 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:56.693689 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:56.693700 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:56.693715 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:56.693751 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:56.696549 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.697150 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.697157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.697159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.697283 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.697600 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.697603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.697605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.697935 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:56.698164 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:56.698410 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 18:54:56.698601 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":337,"threads_started":1}
I20260811 18:54:56.700387 2037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:56.783047 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 1850
I20260811 18:54:56.809235 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2054
Aug 11 18:54:56 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:54:56.825380 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:56.810285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.19.155.195:33893)
0811 18:54:56.810818 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:56.810826 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:56.810858 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:54:56.810988 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:56.810996 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:56.811228 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:56.811368 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:56.812726 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.813709 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.815100 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:56.815655 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:56.815754 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:56.820006 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:56.820018 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:56.820052 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:56.820086 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:56.822839 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.823605 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.823613 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.823615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.823738 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:56.824088 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:56.824091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:56.824093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:56.824434 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:56.824647 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:56.824910 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 18:54:56.825097 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":245,"threads_started":1}
I20260811 18:54:56.826671 2241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:56.908617 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 2054
I20260811 18:54:56.930799 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 1513
I20260811 18:54:56.932152 1609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:54:57.036648 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 1513
I20260811 18:54:57.067884 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46057
--webserver_interface=127.19.155.254
--webserver_port=36153
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:57.402760 2270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:57.403151 2270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:57.403333 2270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:57.410298 2270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:57.410450 2270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:57.410560 2270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:57.410673 2270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:57.410761 2270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:57.420514 2270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=36153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:57.421875 2270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:57.423224 2270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:57.435458 2285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:57.435509 2283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:57.435564 2282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:57.440531 2270 server_base.cc:1034] running on GCE node
I20260811 18:54:57.441354 2270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:57.442708 2270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:57.443912 2270 hybrid_clock.cc:648] HybridClock initialized: now 1786474497443854 us; error 56 us; skew 500 ppm
I20260811 18:54:57.444289 2270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:57 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474497, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:57.451642 2270 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:54:57.453405 2270 webserver.cc:460] Webserver started at http://127.19.155.254:36153/ using document root <none> and password file <none>
I20260811 18:54:57.454129 2270 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:57.454288 2270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:57.459636 2270 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:54:57.462494 2295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:57.463893 2270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:57.464080 2270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "0fae40e08bf84be9878d77d363ad53fe"
format_stamp: "Formatted at 2026-08-11 18:54:54 on dist-test-slave-1nl6"
server_key: "47f4506105ebbeba2e0fb54c14cd92c9"
server_key_iv: "ecdb972bb2d95dbe8c1940d98cb5029a"
server_key_version: "encryptionkey@0"
I20260811 18:54:57.465111 2270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:57.496655 2270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:57.500834 2270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:57.501125 2270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:57.520794 2270 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46057
I20260811 18:54:57.520828 2388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46057 every 8 connection(s)
I20260811 18:54:57.522277 2270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:57.524698 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 2270
I20260811 18:54:57.525487 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:36805
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:46057
--webserver_port=34589
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:54:57.529434 2389 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:54:57.532701 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Bootstrap starting.
I20260811 18:54:57.558164 2389 log.cc:824] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:57.569564 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:54:57.570207 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Bootstrap complete.
I20260811 18:54:57.583555 2389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:57.584708 2389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fae40e08bf84be9878d77d363ad53fe, State: Initialized, Role: FOLLOWER
I20260811 18:54:57.585448 2389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:57.585737 2389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:57.585858 2389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:57.586047 2389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:54:57.591861 2389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:57.592535 2389 leader_election.cc:302] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fae40e08bf84be9878d77d363ad53fe; no voters:
I20260811 18:54:57.593276 2389 leader_election.cc:288] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:54:57.593433 2397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:54:57.594668 2397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [term 2 LEADER]: Becoming Leader. State: Replica: 0fae40e08bf84be9878d77d363ad53fe, State: Running, Role: LEADER
I20260811 18:54:57.595316 2397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } }
I20260811 18:54:57.595517 2389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:57.597649 2402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fae40e08bf84be9878d77d363ad53fe. Latest consensus state: current_term: 2 leader_uuid: "0fae40e08bf84be9878d77d363ad53fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } } }
I20260811 18:54:57.598069 2402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:57.598662 2399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0fae40e08bf84be9878d77d363ad53fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fae40e08bf84be9878d77d363ad53fe" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46057 } } }
I20260811 18:54:57.599014 2399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:57.606171 2406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:57.612237 2406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:57.613699 2406 catalog_manager.cc:1259] Loaded cluster ID: 5856a6526c8b4b4595251502df15dae6
I20260811 18:54:57.613862 2406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:57.617863 2406 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:57.619379 2406 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0fae40e08bf84be9878d77d363ad53fe: Loaded TSK: 0
I20260811 18:54:57.620945 2406 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:54:57.901887 2393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:57.902169 2393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:57.902319 2393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:57.909741 2393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:57.909850 2393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:57.910025 2393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:54:57.920493 2393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.193.keytab
--principal=oryx/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:36805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=34589
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:57.921883 2393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:57.923385 2393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:57.943579 2438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:57.944145 2439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:57.945037 2393 server_base.cc:1034] running on GCE node
W20260811 18:54:57.945048 2441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:57.945866 2393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:57.947091 2393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:57.948347 2393 hybrid_clock.cc:648] HybridClock initialized: now 1786474497948293 us; error 50 us; skew 500 ppm
I20260811 18:54:57.948699 2393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:57 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474497, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:57.952378 2393 init.cc:377] Logged in from keytab as oryx/127.19.155.193@KRBTEST.COM (short username oryx)
I20260811 18:54:57.953953 2393 webserver.cc:460] Webserver started at http://127.19.155.193:34589/ using document root <none> and password file <none>
I20260811 18:54:57.954650 2393 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:57.954810 2393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:57.960296 2393 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:54:57.963213 2452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:57.964577 2393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:57.964775 2393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "6faefcd6c86f4f93979cf2096b2cb117"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "b2ba52e75a6c862e795fdbcda518828d"
server_key_iv: "8326b4c310c2d43e74823a784a5830cb"
server_key_version: "encryptionkey@0"
I20260811 18:54:57.965831 2393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:57.980741 2393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:57.984583 2393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:57.984863 2393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:57.985834 2393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:57.987283 2393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:57.987423 2393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:57.987578 2393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:57.987689 2393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.022069 2393 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36805
I20260811 18:54:58.022171 2634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36805 every 8 connection(s)
I20260811 18:54:58.023651 2393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:58.029315 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 2393
I20260811 18:54:58.029973 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:39633
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:46057
--webserver_port=39377
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.042303 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.026738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:58021)
0811 18:54:58.027599 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.027655 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.029424 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.031054 (+ 1630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.031068 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.031704 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.032243 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.032260 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.033884 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.033890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.035178 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.035190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.036274 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.036283 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.036549 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.037255 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.037282 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.041037 (+ 3755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":362,"threads_started":1}
W20260811 18:54:58.042476 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.026647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:58021 (local address 127.19.155.254:46057)
0811 18:54:58.027543 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.027561 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.027800 (+ 239us) server_negotiation.cc:407] Connection header received
0811 18:54:58.030035 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.030048 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.030503 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.030881 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.032455 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.033701 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.035331 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.036002 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.036220 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.041398 (+ 5178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:58021: BlockingRecv error: recv got EOF from 127.19.155.193:58021 (error 108)
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":338,"threads_started":1}
W20260811 18:54:58.043175 2635 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46057 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.155.254:46057: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.052670 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.043745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:39597)
0811 18:54:58.043967 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.043989 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.044089 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.044412 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.044419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.044850 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.045059 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.045073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.046043 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.046050 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.047727 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.047745 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.048397 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.048405 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.048620 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.049182 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.049208 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.052391 (+ 3183us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 18:54:58.052812 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.043981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:39597 (local address 127.19.155.254:46057)
0811 18:54:58.044139 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.044143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.044159 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:54:58.044200 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.044204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.044255 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.044347 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.045200 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.045887 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.047867 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.048226 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.048329 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.052579 (+ 4250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:39597: BlockingRecv error: recv got EOF from 127.19.155.193:39597 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:54:58.061117 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.053564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:38953 (local address 127.19.155.254:46057)
0811 18:54:58.053735 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.053742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.053769 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:54:58.053819 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.053822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.053883 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.053994 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.054622 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.055357 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.056530 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.056934 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.057073 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.060942 (+ 3869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:38953: BlockingRecv error: recv got EOF from 127.19.155.193:38953 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:54:58.061133 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.053411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:38953)
0811 18:54:58.053564 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.053581 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.053706 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.054018 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.054022 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.054345 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.054482 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.054490 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.055500 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.055505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.056376 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.056386 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.057082 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.057088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.057282 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.057843 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.057859 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.060785 (+ 2926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:54:58.061425 2635 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:54:58.378476 2640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:58.378729 2640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:58.378839 2640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:58.385780 2640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:58.385913 2640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:58.386067 2640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:54:58.395670 2640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.194.keytab
--principal=oryx/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:39633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=39377
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:58.396997 2640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:58.398285 2640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:58.412025 2653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:58.412091 2649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:58.412104 2648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:58.412984 2640 server_base.cc:1034] running on GCE node
I20260811 18:54:58.413581 2640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:58.414445 2640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:58.415665 2640 hybrid_clock.cc:648] HybridClock initialized: now 1786474498415594 us; error 55 us; skew 500 ppm
I20260811 18:54:58.416015 2640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474498, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:58.419251 2640 init.cc:377] Logged in from keytab as oryx/127.19.155.194@KRBTEST.COM (short username oryx)
I20260811 18:54:58.420840 2640 webserver.cc:460] Webserver started at http://127.19.155.194:39377/ using document root <none> and password file <none>
I20260811 18:54:58.421536 2640 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:58.421702 2640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:58.427161 2640 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:54:58.429873 2662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.431293 2640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:54:58.431483 2640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "764de55760644451a75b4aa4bb3a9355"
format_stamp: "Formatted at 2026-08-11 18:54:55 on dist-test-slave-1nl6"
server_key: "36644ec3b5b26f69b20aeb992d3865db"
server_key_iv: "2e69cdd27ec548bc680cedc6b733472e"
server_key_version: "encryptionkey@0"
I20260811 18:54:58.432463 2640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:58.447819 2640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:58.451745 2640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:58.452039 2640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:58.453032 2640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:58.454360 2640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:58.454510 2640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.454641 2640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:58.454738 2640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.489553 2640 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39633
I20260811 18:54:58.489647 2851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39633 every 8 connection(s)
I20260811 18:54:58.491079 2640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:54:58.492064 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 2640
I20260811 18:54:58.492832 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:33893
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:46057
--webserver_port=41319
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:54:58.507530 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.493845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:43639 (local address 127.19.155.254:46057)
0811 18:54:58.494085 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.494093 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.495283 (+ 1190us) server_negotiation.cc:407] Connection header received
0811 18:54:58.497298 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.497304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.497388 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.497507 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.498988 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.499730 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.501239 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.501656 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.501800 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.507269 (+ 5469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:43639: BlockingRecv error: recv got EOF from 127.19.155.194:43639 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:54:58.508183 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.494247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:43639)
0811 18:54:58.495105 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.495149 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.497009 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.497754 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.497768 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.498229 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.498772 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.498789 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.499904 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.499922 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.501078 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.501090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.501893 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.501900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.502140 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.502812 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.502833 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.507045 (+ 4212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":347,"threads_started":1}
W20260811 18:54:58.508872 2852 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46057 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.155.254:46057: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.518343 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.509484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:47931)
0811 18:54:58.509653 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.509678 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.509770 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.510087 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.510090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.510375 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.510488 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.510494 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.511673 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.511681 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.513344 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.513366 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.514074 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.514082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.514307 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.514924 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.514954 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.518159 (+ 3205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 18:54:58.518761 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.509588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:47931 (local address 127.19.155.254:46057)
0811 18:54:58.509777 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.509785 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.509807 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:54:58.509860 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.509878 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.509957 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.510063 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.510655 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.511507 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.513520 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.513918 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.514005 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.518467 (+ 4462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:47931: BlockingRecv error: recv got EOF from 127.19.155.194:47931 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.529223 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.519198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:43003)
0811 18:54:58.519341 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.519358 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.519449 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.519945 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.519950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.520331 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.520534 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.520544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.522167 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.522172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.523604 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.523619 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.524832 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.524838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.525035 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.525678 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.525699 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.528953 (+ 3254us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:54:58.529393 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.519381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:43003 (local address 127.19.155.254:46057)
0811 18:54:58.519583 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.519592 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.519612 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:54:58.519669 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.519674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.519757 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.519909 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.520700 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.521998 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.523776 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.524650 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.524808 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.529188 (+ 4380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:43003: BlockingRecv error: recv got EOF from 127.19.155.194:43003 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 18:54:58.529656 2852 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:54:58.836036 2856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:58.836395 2856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:58.836591 2856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:58.843956 2856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:58.844123 2856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:58.844309 2856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:54:58.854185 2856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/krb5kdc/oryx_127.19.155.195.keytab
--principal=oryx/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:33893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=41319
--tserver_master_addrs=127.19.155.254:46057
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:54:58.855628 2856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:58.856953 2856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:58.870914 2865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:58.871012 2871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:58.871048 2866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:58.871961 2856 server_base.cc:1034] running on GCE node
I20260811 18:54:58.872648 2856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:58.873673 2856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:58.874997 2856 hybrid_clock.cc:648] HybridClock initialized: now 1786474498874946 us; error 60 us; skew 500 ppm
I20260811 18:54:58.875342 2856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474498, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:58.878871 2856 init.cc:377] Logged in from keytab as oryx/127.19.155.195@KRBTEST.COM (short username oryx)
I20260811 18:54:58.880461 2856 webserver.cc:460] Webserver started at http://127.19.155.195:41319/ using document root <none> and password file <none>
I20260811 18:54:58.881116 2856 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:58.881242 2856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:58.886690 2856 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:54:58.889451 2879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.891027 2856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:54:58.891213 2856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "8c40567819144df7b38239adba3c4639"
format_stamp: "Formatted at 2026-08-11 18:54:56 on dist-test-slave-1nl6"
server_key: "a07781d749e3689ff694c633cb97df2c"
server_key_iv: "0783585c52da7fee3693d866bbe07853"
server_key_version: "encryptionkey@0"
I20260811 18:54:58.892206 2856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:58.917829 2856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:58.922324 2856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:58.922570 2856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:58.923699 2856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:58.924962 2856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:58.925063 2856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.925135 2856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:58.925190 2856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:58.959667 2856 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:33893
I20260811 18:54:58.959765 3055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:33893 every 8 connection(s)
I20260811 18:54:58.961139 2856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:58.964118 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 2856
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:54:58.979576 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.963942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59763 (local address 127.19.155.254:46057)
0811 18:54:58.964198 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.964206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.965449 (+ 1243us) server_negotiation.cc:407] Connection header received
0811 18:54:58.968724 (+ 3275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.968727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.968775 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.968854 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.970990 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.971746 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.973317 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.973735 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.973877 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.979374 (+ 5497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:59763: BlockingRecv error: recv got EOF from 127.19.155.195:59763 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:54:58.980322 3060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.964405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:59763)
0811 18:54:58.965274 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.965325 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.968414 (+ 3089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.969206 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.969219 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.970038 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.970795 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.970817 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.971921 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.971926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.973143 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.973156 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.973976 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.973984 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.974239 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.974868 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.974893 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.979216 (+ 4323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":331,"threads_started":1}
W20260811 18:54:58.981033 3058 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46057 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.155.254:46057: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
I20260811 18:54:58.983443 3065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.965316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47852 (local address 127.19.155.254:46057)
0811 18:54:58.967371 (+ 2055us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.967376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.967750 (+ 374us) server_negotiation.cc:407] Connection header received
0811 18:54:58.967928 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.967932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.968022 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.968142 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.970323 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.971239 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.972547 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.972962 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.973100 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.976025 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:58.976033 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:58.976047 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:58.976086 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:58.979727 (+ 3641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:58.980403 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:58.980414 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:58.980423 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:58.981073 (+ 650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:58.981521 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:58.981525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:58.981527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:58.982017 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:58.982356 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:58.982740 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 18:54:58.983103 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1913,"thread_start_us":1783,"threads_started":1}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.989177 3060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.981638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:55629)
0811 18:54:58.981812 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.981830 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.981921 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.982364 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.982369 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.982755 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.982970 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.982983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.984067 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.984073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.984860 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.984871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.985577 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.985586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.985709 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.986230 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.986245 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.989001 (+ 2756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 18:54:58.989385 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.981888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:55629 (local address 127.19.155.254:46057)
0811 18:54:58.982076 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.982084 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.982103 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:54:58.982149 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.982153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.982214 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.982318 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.983144 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.983932 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.984996 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.985402 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.985543 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.989150 (+ 3607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:55629: BlockingRecv error: recv got EOF from 127.19.155.195:55629 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:58 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:58.996944 3060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:58.989751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:60389)
0811 18:54:58.989937 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:58.989954 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:58.990048 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:58.990312 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:58.990314 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:58.990558 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:58.990692 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.990700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.991739 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.991743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.992667 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:58.992700 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.993337 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.993352 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:58.993474 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.993960 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:58.993977 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:58.996667 (+ 2690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:54:58.997099 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:58.989853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:60389 (local address 127.19.155.254:46057)
0811 18:54:58.990091 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:58.990094 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:58.990107 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:54:58.990138 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:58.990141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:58.990199 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:58.990269 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:58.990808 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.991613 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.992827 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:58.993209 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:58.993303 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:58.996851 (+ 3548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:60389: BlockingRecv error: recv got EOF from 127.19.155.195:60389 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
W20260811 18:54:58.997444 3058 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 18:54:59 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:59 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:59.070832 3067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:59.062011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:35051)
0811 18:54:59.062572 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:59.062588 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:59.062701 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:59.063050 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:59.063053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:59.063491 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:59.063679 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:59.063688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.064652 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.064658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:59.065596 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:59.065608 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.066369 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.066375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:59.066564 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:59.067217 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:59.067237 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:59.070453 (+ 3216us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":316,"threads_started":1}
W20260811 18:54:59.071007 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:59.062102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:35051 (local address 127.19.155.254:46057)
0811 18:54:59.062321 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:59.062326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:59.062665 (+ 339us) server_negotiation.cc:407] Connection header received
0811 18:54:59.062796 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:59.062799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:59.062858 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:59.063024 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:59.063804 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.064488 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.065748 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.066181 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.066313 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:59.070723 (+ 4410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:35051: BlockingRecv error: recv got EOF from 127.19.155.193:35051 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 18:54:59 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:54:59 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:54:59.539572 3069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:59.530484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:45381)
0811 18:54:59.531084 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:59.531100 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:59.531268 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:59.531642 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:59.531647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:59.532156 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:59.532356 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:59.532365 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.533399 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.533405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:59.534376 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:59.534388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.535419 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.535423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:59.535700 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:59.536417 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:59.536435 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:59.539347 (+ 2912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":289,"threads_started":1}
W20260811 18:54:59.539765 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:59.530539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:45381 (local address 127.19.155.254:46057)
0811 18:54:59.530801 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:59.530810 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:59.531197 (+ 387us) server_negotiation.cc:407] Connection header received
0811 18:54:59.531399 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:59.531404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:59.531474 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:59.531589 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:59.532511 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.533224 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.534530 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:59.535224 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:59.535369 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:59.539537 (+ 4168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:45381: BlockingRecv error: recv got EOF from 127.19.155.194:45381 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:00.007193 3071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:59.998036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:35239)
0811 18:54:59.998545 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:59.998562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:59.998723 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:59.999128 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:59.999133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:59.999656 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:59.999912 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:59.999923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.001225 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.001231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.002235 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:00.002248 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.003013 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.003020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.003194 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.003855 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:00.003873 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:00.006887 (+ 3014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":269,"threads_started":1}
W20260811 18:55:00.007409 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:54:59.998118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:35239 (local address 127.19.155.254:46057)
0811 18:54:59.998364 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:59.998373 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:59.998650 (+ 277us) server_negotiation.cc:407] Connection header received
0811 18:54:59.998852 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:59.998857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:59.998959 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:59.999071 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:00.000054 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.001033 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.002393 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.002789 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.002960 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.007147 (+ 4187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:35239: BlockingRecv error: recv got EOF from 127.19.155.195:35239 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:00.080864 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:00.072097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:52371)
0811 18:55:00.072724 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:00.072741 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:00.072920 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:00.073461 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:00.073466 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:00.073873 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:00.074045 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:00.074054 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.075173 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.075177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.076078 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:00.076089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.076796 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.076800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.076916 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.077583 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:00.077602 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:00.080611 (+ 3009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":289,"threads_started":1}
W20260811 18:55:00.081037 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:00.072167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:52371 (local address 127.19.155.254:46057)
0811 18:55:00.072394 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:00.072402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:00.072872 (+ 470us) server_negotiation.cc:407] Connection header received
0811 18:55:00.073082 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:00.073087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:00.073267 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:00.073385 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:00.074217 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.075053 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.076224 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.076657 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.076751 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.080788 (+ 4037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:52371: BlockingRecv error: recv got EOF from 127.19.155.193:52371 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:00 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:00.548537 3074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:00.540545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:43409)
0811 18:55:00.541037 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:00.541054 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:00.541170 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:00.541474 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:00.541478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:00.541865 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:00.542038 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:00.542046 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.543045 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.543049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.543927 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:00.543938 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.544598 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.544602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:00.544716 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.545273 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:00.545291 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:00.548214 (+ 2923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":275,"threads_started":1}
W20260811 18:55:00.548692 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:00.540599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:43409 (local address 127.19.155.254:46057)
0811 18:55:00.540833 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:00.540842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:00.541143 (+ 301us) server_negotiation.cc:407] Connection header received
0811 18:55:00.541271 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:00.541274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:00.541343 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:00.541421 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:00.542160 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.542868 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.544045 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:00.544463 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:00.544555 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:00.548450 (+ 3895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:43409: BlockingRecv error: recv got EOF from 127.19.155.194:43409 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:01.016749 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:01.008255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:45255)
0811 18:55:01.008797 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:01.008818 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:01.008955 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:01.009248 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:01.009251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:01.009661 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:01.009827 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.009845 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.010823 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.010827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.011879 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.011913 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.012853 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.012860 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.012993 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.013641 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:01.013660 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:01.016401 (+ 2741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":279,"threads_started":1}
W20260811 18:55:01.016863 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:01.008473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:45255 (local address 127.19.155.254:46057)
0811 18:55:01.008682 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:01.008688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:01.008912 (+ 224us) server_negotiation.cc:407] Connection header received
0811 18:55:01.009054 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:01.009058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:01.009116 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:01.009195 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:01.009956 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.010675 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.012037 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.012630 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.012787 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.016604 (+ 3817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:45255: BlockingRecv error: recv got EOF from 127.19.155.195:45255 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:01.090132 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:01.081851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:55045)
0811 18:55:01.082408 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:01.082429 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:01.082569 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:01.082999 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:01.083007 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:01.083402 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:01.083631 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.083644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.084783 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.084786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.085717 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.085729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.086375 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.086379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.086496 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.087162 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:01.087179 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:01.089881 (+ 2702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":312,"threads_started":1}
W20260811 18:55:01.090346 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:01.082006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:55045 (local address 127.19.155.254:46057)
0811 18:55:01.082222 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:01.082230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:01.082506 (+ 276us) server_negotiation.cc:407] Connection header received
0811 18:55:01.082703 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:01.082707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:01.082805 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:01.082932 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:01.083791 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.084626 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.085846 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.086230 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.086335 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.090072 (+ 3737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:55045: BlockingRecv error: recv got EOF from 127.19.155.193:55045 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:01 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:01.558620 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:01.549554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:55793)
0811 18:55:01.550057 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:01.550072 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:01.550242 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:01.550629 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:01.550636 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:01.551091 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:01.551295 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.551304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.552396 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.552401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.553307 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:01.553318 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.554023 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.554028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:01.554225 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.554881 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:01.554944 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:01.558309 (+ 3365us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":274,"threads_started":1}
W20260811 18:55:01.558698 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:01.549617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:55793 (local address 127.19.155.254:46057)
0811 18:55:01.549876 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:01.549885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:01.550174 (+ 289us) server_negotiation.cc:407] Connection header received
0811 18:55:01.550385 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:01.550390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:01.550459 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:01.550577 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:01.551444 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.552236 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.553459 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:01.553864 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:01.554009 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:01.558516 (+ 4507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:55793: BlockingRecv error: recv got EOF from 127.19.155.194:55793 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:02.026304 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:02.017792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:38609)
0811 18:55:02.018311 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:02.018328 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:02.018488 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:02.018852 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:02.018858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:02.019250 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:02.019428 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.019437 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.020474 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.020480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.021379 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.021391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.022325 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.022330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.022466 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.023168 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:02.023185 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:02.026066 (+ 2881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":287,"threads_started":1}
W20260811 18:55:02.026499 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:02.017908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:38609 (local address 127.19.155.254:46057)
0811 18:55:02.018123 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:02.018132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:02.018426 (+ 294us) server_negotiation.cc:407] Connection header received
0811 18:55:02.018617 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:02.018623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:02.018693 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:02.018812 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:02.019585 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.020321 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.021533 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.022125 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.022255 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.026261 (+ 4006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:38609: BlockingRecv error: recv got EOF from 127.19.155.195:38609 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:02.099452 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:02.091085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:38247)
0811 18:55:02.091543 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:02.091558 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:02.091669 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:02.091960 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:02.091963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:02.092369 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:02.092523 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.092531 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.093475 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.093478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.094448 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.094459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.095221 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.095225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.095428 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.096083 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:02.096101 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:02.099098 (+ 2997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":265,"threads_started":1}
W20260811 18:55:02.099558 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:02.091118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:38247 (local address 127.19.155.254:46057)
0811 18:55:02.091383 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:02.091390 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:02.091650 (+ 260us) server_negotiation.cc:407] Connection header received
0811 18:55:02.091770 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:02.091774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:02.091835 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:02.091906 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:02.092647 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.093365 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.094572 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.095091 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.095187 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.099301 (+ 4114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:38247: BlockingRecv error: recv got EOF from 127.19.155.193:38247 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:02 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:02.572441 3084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:02.559693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:37769)
0811 18:55:02.560244 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:02.560269 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:02.560391 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:02.560688 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:02.560691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:02.561056 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:02.561212 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.561221 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.562211 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.562215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.563212 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:02.563223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.563854 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.563858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:02.564002 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.568857 (+ 4855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:02.568909 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:02.572076 (+ 3167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":317,"threads_started":1}
W20260811 18:55:02.572539 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:02.559762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37769 (local address 127.19.155.254:46057)
0811 18:55:02.559988 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:02.559993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:02.560370 (+ 377us) server_negotiation.cc:407] Connection header received
0811 18:55:02.560488 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:02.560492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:02.560556 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:02.560641 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:02.561342 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.562084 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.563338 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:02.563724 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:02.563828 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:02.572292 (+ 8464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:37769: BlockingRecv error: recv got EOF from 127.19.155.194:37769 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:03.036235 3086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:03.027419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:36463)
0811 18:55:03.027943 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:03.027960 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:03.028115 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:03.028502 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:03.028507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:03.028934 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:03.029087 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.029096 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.030454 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.030459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.031638 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.031652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.032309 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.032313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.032436 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.033025 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:03.033041 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:03.035956 (+ 2915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":290,"threads_started":1}
W20260811 18:55:03.036399 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:03.027579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:36463 (local address 127.19.155.254:46057)
0811 18:55:03.027766 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:03.027773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:03.028042 (+ 269us) server_negotiation.cc:407] Connection header received
0811 18:55:03.028232 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:03.028236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:03.028309 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:03.028401 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:03.029254 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.030278 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.031768 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.032183 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.032288 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.036170 (+ 3882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:36463: BlockingRecv error: recv got EOF from 127.19.155.195:36463 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:03.109333 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:03.100448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:38355)
0811 18:55:03.101018 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:03.101034 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:03.101201 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:03.101569 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:03.101573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:03.102055 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:03.102222 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.102231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.103555 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.103564 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.104528 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.104540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.105298 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.105304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.105491 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.106061 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:03.106079 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:03.109059 (+ 2980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":290,"threads_started":1}
W20260811 18:55:03.109483 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:03.100514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:38355 (local address 127.19.155.254:46057)
0811 18:55:03.100759 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:03.100768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:03.101135 (+ 367us) server_negotiation.cc:407] Connection header received
0811 18:55:03.101361 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:03.101365 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:03.101427 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:03.101536 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:03.102422 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.103406 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.104694 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.105136 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.105274 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.109271 (+ 3997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:38355: BlockingRecv error: recv got EOF from 127.19.155.193:38355 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:03 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:03.582036 3089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:03.573437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:52481)
0811 18:55:03.573990 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:03.574005 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:03.574159 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:03.574502 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:03.574508 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:03.575001 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:03.575155 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.575165 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.576215 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.576221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.577199 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:03.577218 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.577948 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.577953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:03.578137 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.578753 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:03.578773 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:03.581804 (+ 3031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":270,"threads_started":1}
W20260811 18:55:03.582226 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:03.573648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:52481 (local address 127.19.155.254:46057)
0811 18:55:03.573879 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:03.573885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:03.574091 (+ 206us) server_negotiation.cc:407] Connection header received
0811 18:55:03.574282 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:03.574293 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:03.574360 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:03.574464 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:03.575320 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.576066 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.577364 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:03.577795 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:03.577935 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:03.581977 (+ 4042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:52481: BlockingRecv error: recv got EOF from 127.19.155.194:52481 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:04.045980 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:04.037223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:40067)
0811 18:55:04.037729 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:04.037745 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:04.037854 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:04.038149 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:04.038152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:04.038547 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:04.038707 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.038715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.039874 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.039880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.041322 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.041352 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.042036 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.042041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.042167 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.042717 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:04.042734 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:04.045611 (+ 2877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":259,"threads_started":1}
W20260811 18:55:04.046080 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:04.037324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:40067 (local address 127.19.155.254:46057)
0811 18:55:04.037572 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:04.037578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:04.037832 (+ 254us) server_negotiation.cc:407] Connection header received
0811 18:55:04.037954 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:04.037958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:04.038019 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:04.038103 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:04.038841 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.039722 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.041491 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.041907 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.042002 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.045829 (+ 3827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:40067: BlockingRecv error: recv got EOF from 127.19.155.195:40067 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:04.118747 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:04.110390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:45859)
0811 18:55:04.111034 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:04.111052 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:04.111206 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:04.111580 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:04.111585 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:04.112017 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:04.112198 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.112208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.113255 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.113261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.114163 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.114174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.114930 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.114936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.115122 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.115704 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:04.115721 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:04.118406 (+ 2685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":314,"threads_started":1}
W20260811 18:55:04.118882 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:04.110454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:45859 (local address 127.19.155.254:46057)
0811 18:55:04.110683 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:04.110692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:04.111138 (+ 446us) server_negotiation.cc:407] Connection header received
0811 18:55:04.111363 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:04.111374 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:04.111437 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:04.111542 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:04.112354 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.113110 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.114313 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.114726 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.114869 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.118608 (+ 3739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:45859: BlockingRecv error: recv got EOF from 127.19.155.193:45859 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:04 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:04.591251 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:04.582908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:39459)
0811 18:55:04.583466 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:04.583482 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:04.583636 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:04.583990 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:04.583995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:04.584465 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:04.584628 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.584637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.585656 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.585661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.586537 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:04.586548 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.587374 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.587380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:04.587559 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.588131 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:04.588147 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:04.591019 (+ 2872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":297,"threads_started":1}
W20260811 18:55:04.591495 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:04.582986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39459 (local address 127.19.155.254:46057)
0811 18:55:04.583187 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:04.583194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:04.583575 (+ 381us) server_negotiation.cc:407] Connection header received
0811 18:55:04.583773 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:04.583780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:04.583846 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:04.583952 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:04.584787 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.585504 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.586687 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:04.587199 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:04.587348 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:04.591255 (+ 3907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:39459: BlockingRecv error: recv got EOF from 127.19.155.194:39459 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:05.054800 3096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:05.046992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:35345)
0811 18:55:05.047508 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:05.047524 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:05.047637 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:05.047922 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:05.047925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:05.048308 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:05.048468 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.048475 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.049480 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.049484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.050394 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.050405 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.051109 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.051113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.051248 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.051804 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:05.051821 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:05.054586 (+ 2765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":260,"threads_started":1}
W20260811 18:55:05.055037 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:05.047085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:35345 (local address 127.19.155.254:46057)
0811 18:55:05.047330 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:05.047337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:05.047609 (+ 272us) server_negotiation.cc:407] Connection header received
0811 18:55:05.047721 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:05.047724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:05.047793 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:05.047873 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:05.048588 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.049363 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.050522 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.050975 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.051066 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.054787 (+ 3721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:35345: BlockingRecv error: recv got EOF from 127.19.155.195:35345 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:05.128791 3097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:05.119736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:51469)
0811 18:55:05.120393 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:05.120409 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:05.120578 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:05.121008 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:05.121014 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:05.121478 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:05.121651 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.121661 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.122703 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.122710 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.123700 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.123712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.124464 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.124470 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.124638 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.125311 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:05.125330 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:05.128536 (+ 3206us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":297,"threads_started":1}
W20260811 18:55:05.128953 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:05.119952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:51469 (local address 127.19.155.254:46057)
0811 18:55:05.120206 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:05.120213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:05.120503 (+ 290us) server_negotiation.cc:407] Connection header received
0811 18:55:05.120708 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:05.120713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:05.120784 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:05.120924 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:05.121806 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.122547 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.123857 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.124298 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.124446 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.128720 (+ 4274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:51469: BlockingRecv error: recv got EOF from 127.19.155.193:51469 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:05 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:05.601490 3098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:05.592332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:56327)
0811 18:55:05.593011 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:05.593027 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:05.593202 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:05.593647 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:05.593653 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:05.594216 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:05.594486 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.594500 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.595614 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.595618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.596803 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:05.596816 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.597524 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.597528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:05.597639 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.598279 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:05.598297 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:05.601223 (+ 2926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":313,"threads_started":1}
W20260811 18:55:05.601681 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:05.592409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:56327 (local address 127.19.155.254:46057)
0811 18:55:05.592628 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:05.592633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:05.593150 (+ 517us) server_negotiation.cc:407] Connection header received
0811 18:55:05.593387 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:05.593393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:05.593477 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:05.593604 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:05.594651 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.595459 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.596967 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:05.597385 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:05.597480 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:05.601415 (+ 3935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:56327: BlockingRecv error: recv got EOF from 127.19.155.194:56327 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:06.064388 3099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:06.055746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:46295)
0811 18:55:06.056263 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:06.056279 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:06.056445 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:06.056781 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:06.056786 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:06.057256 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:06.057442 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.057452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.058450 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.058456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.059524 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.059537 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.060266 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.060273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.060462 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.061080 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:06.061097 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:06.064000 (+ 2903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":225,"threads_started":1}
W20260811 18:55:06.064409 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:06.055836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:46295 (local address 127.19.155.254:46057)
0811 18:55:06.056033 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:06.056041 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:06.056379 (+ 338us) server_negotiation.cc:407] Connection header received
0811 18:55:06.056573 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:06.056578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:06.056644 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:06.056750 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:06.057589 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.058311 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.059659 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.060085 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.060243 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.064194 (+ 3951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:46295: BlockingRecv error: recv got EOF from 127.19.155.195:46295 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:06.138494 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:06.129821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:35219)
0811 18:55:06.130367 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:06.130385 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:06.130498 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:06.130806 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:06.130809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:06.131228 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:06.131389 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.131398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.132389 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.132393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.133289 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.133299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.133994 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.133998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.134103 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.134740 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:06.134758 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:06.138070 (+ 3312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":288,"threads_started":1}
W20260811 18:55:06.138684 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:06.130028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:35219 (local address 127.19.155.254:46057)
0811 18:55:06.130291 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:06.130300 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:06.130463 (+ 163us) server_negotiation.cc:407] Connection header received
0811 18:55:06.130596 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:06.130599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:06.130668 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:06.130748 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:06.131521 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.132262 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.133419 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.133842 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.133930 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.138359 (+ 4429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:35219: BlockingRecv error: recv got EOF from 127.19.155.193:35219 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:06 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:06.611444 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:06.602616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:39593)
0811 18:55:06.603468 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:06.603490 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:06.603641 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:06.604039 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:06.604044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:06.604550 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:06.604712 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.604722 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.605876 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.605879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.606761 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:06.606773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.607605 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.607609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:06.607729 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.608371 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:06.608390 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:06.611209 (+ 2819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":323,"threads_started":1}
W20260811 18:55:06.611603 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:06.602711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39593 (local address 127.19.155.254:46057)
0811 18:55:06.602953 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:06.602962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:06.603589 (+ 627us) server_negotiation.cc:407] Connection header received
0811 18:55:06.603787 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:06.603793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:06.603881 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:06.603961 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:06.604849 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.605746 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.606891 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:06.607443 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:06.607539 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:06.611398 (+ 3859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:39593: BlockingRecv error: recv got EOF from 127.19.155.194:39593 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:07.074738 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:07.065374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:44875)
0811 18:55:07.065987 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:07.066005 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:07.066177 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:07.066543 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:07.066548 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:07.067019 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:07.067176 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.067185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.068364 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.068370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.069441 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.069455 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.070261 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.070267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.070461 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.071234 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:07.071254 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:07.074367 (+ 3113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":323,"threads_started":1}
W20260811 18:55:07.074932 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:07.065605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:44875 (local address 127.19.155.254:46057)
0811 18:55:07.065873 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:07.065880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:07.066095 (+ 215us) server_negotiation.cc:407] Connection header received
0811 18:55:07.066307 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:07.066317 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:07.066380 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:07.066506 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:07.067333 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.068198 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.069589 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.070071 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.070214 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.074615 (+ 4401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:44875: BlockingRecv error: recv got EOF from 127.19.155.195:44875 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:07.148319 3107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:07.139517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:41231)
0811 18:55:07.140064 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:07.140079 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:07.140241 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:07.140614 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:07.140619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:07.141052 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:07.141220 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.141228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.142268 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.142275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.143245 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.143257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.143977 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.143982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.144160 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.144803 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:07.144820 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:07.148080 (+ 3260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":294,"threads_started":1}
W20260811 18:55:07.148500 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:07.139574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:41231 (local address 127.19.155.254:46057)
0811 18:55:07.139813 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:07.139822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:07.140174 (+ 352us) server_negotiation.cc:407] Connection header received
0811 18:55:07.140406 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:07.140410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:07.140471 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:07.140578 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:07.141380 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.142126 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.143401 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.143816 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.143965 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.148259 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:41231: BlockingRecv error: recv got EOF from 127.19.155.193:41231 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:07 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:07.625018 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:07.612450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:37417)
0811 18:55:07.613030 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:07.613047 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:07.613161 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:07.613466 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:07.613469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:07.613865 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:07.614038 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.614046 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.615081 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.615085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.616029 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:07.616039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.616705 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.616709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:07.616823 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.621551 (+ 4728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:07.621569 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:07.624647 (+ 3078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":312,"threads_started":1}
W20260811 18:55:07.625084 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:07.612540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37417 (local address 127.19.155.254:46057)
0811 18:55:07.612713 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:07.612718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:07.613124 (+ 406us) server_negotiation.cc:407] Connection header received
0811 18:55:07.613261 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:07.613264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:07.613324 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:07.613412 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:07.614161 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.614888 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.616146 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:07.616564 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:07.616648 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:07.624850 (+ 8202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:37417: BlockingRecv error: recv got EOF from 127.19.155.194:37417 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:08.084030 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:08.075793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:33979)
0811 18:55:08.076315 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:08.076333 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:08.076452 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:08.076719 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:08.076722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:08.077114 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:08.077299 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.077308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.078248 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.078252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.079194 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.079206 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.079837 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.079841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.079958 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.080532 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:08.080549 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:08.083682 (+ 3133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
W20260811 18:55:08.084164 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:08.075852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:33979 (local address 127.19.155.254:46057)
0811 18:55:08.076085 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:08.076095 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:08.076419 (+ 324us) server_negotiation.cc:407] Connection header received
0811 18:55:08.076535 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:08.076539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:08.076599 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:08.076686 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:08.077427 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.078141 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.079310 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.079712 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.079801 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.083927 (+ 4126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:33979: BlockingRecv error: recv got EOF from 127.19.155.195:33979 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:08.159426 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:08.149289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:54307)
0811 18:55:08.151367 (+ 2078us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:08.151390 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:08.151506 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:08.151814 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:08.151817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:08.152245 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:08.152397 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.152407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.153384 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.153387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.154330 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.154342 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.155401 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.155407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.155582 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.156231 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:08.156249 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:08.159088 (+ 2839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1953,"thread_start_us":1824,"threads_started":1}
W20260811 18:55:08.159535 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:08.149391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54307 (local address 127.19.155.254:46057)
0811 18:55:08.149558 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:08.149562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:08.151465 (+ 1903us) server_negotiation.cc:407] Connection header received
0811 18:55:08.151601 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:08.151604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:08.151679 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:08.151763 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:08.152536 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.153271 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.154525 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.155236 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.155388 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.159277 (+ 3889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:54307: BlockingRecv error: recv got EOF from 127.19.155.193:54307 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:08 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:08.634711 3116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:08.626142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:46723)
0811 18:55:08.626886 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:08.626946 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:08.627095 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:08.627531 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:08.627536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:08.628030 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:08.628192 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.628201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.629236 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.629243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.630194 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:08.630207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.630979 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.630991 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:08.631163 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.631717 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:08.631734 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:08.634487 (+ 2753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":463,"threads_started":1}
W20260811 18:55:08.634967 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:08.626225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:46723 (local address 127.19.155.254:46057)
0811 18:55:08.626436 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:08.626443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:08.627048 (+ 605us) server_negotiation.cc:407] Connection header received
0811 18:55:08.627306 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:08.627311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:08.627384 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:08.627501 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:08.628351 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.629075 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.630343 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:08.630792 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:08.630948 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:08.634684 (+ 3736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:46723: BlockingRecv error: recv got EOF from 127.19.155.194:46723 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:09.093524 3118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:09.085074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:58779)
0811 18:55:09.085610 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:09.085625 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:09.085778 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:09.086133 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:09.086138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:09.086564 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:09.086706 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.086715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.087836 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.087842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.088770 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.088781 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.089489 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.089495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.089660 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.090299 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:09.090317 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:09.093155 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":308,"threads_started":1}
W20260811 18:55:09.093577 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:09.085321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:58779 (local address 127.19.155.254:46057)
0811 18:55:09.085541 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:09.085547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:09.085711 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:55:09.085929 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:09.085933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:09.085993 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:09.086101 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:09.086882 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.087691 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.088913 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.089322 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.089457 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.093342 (+ 3885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:58779: BlockingRecv error: recv got EOF from 127.19.155.195:58779 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:09.169529 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:09.160433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:40661)
0811 18:55:09.160987 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:09.161004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:09.161156 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:09.161541 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:09.161548 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:09.162006 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:09.162181 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.162190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.163381 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.163390 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.164290 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.164302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.165056 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.165063 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.165243 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.165846 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:09.165864 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:09.169135 (+ 3271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":291,"threads_started":1}
W20260811 18:55:09.169958 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:09.160554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:40661 (local address 127.19.155.254:46057)
0811 18:55:09.160806 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:09.160813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:09.161091 (+ 278us) server_negotiation.cc:407] Connection header received
0811 18:55:09.161301 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:09.161306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:09.161395 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:09.161502 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:09.162346 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.163229 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.164434 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.164893 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.165023 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.169504 (+ 4481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:40661: BlockingRecv error: recv got EOF from 127.19.155.193:40661 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:09 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:09.644032 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:09.635548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:33347)
0811 18:55:09.636119 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:09.636135 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:09.636246 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:09.636556 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:09.636559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:09.637043 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:09.637276 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.637287 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.638262 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.638265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.639230 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:09.639242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.639948 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.639954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:09.640152 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.640791 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:09.640808 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:09.643794 (+ 2986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":328,"threads_started":1}
W20260811 18:55:09.644201 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:09.635804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:33347 (local address 127.19.155.254:46057)
0811 18:55:09.635997 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:09.636009 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:09.636217 (+ 208us) server_negotiation.cc:407] Connection header received
0811 18:55:09.636347 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:09.636351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:09.636411 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:09.636495 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:09.637414 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.638143 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.639349 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:09.639757 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:09.639872 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:09.643987 (+ 4115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:33347: BlockingRecv error: recv got EOF from 127.19.155.194:33347 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:10.103400 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:10.094490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:43809)
0811 18:55:10.095040 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:10.095056 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:10.095166 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:10.095465 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:10.095469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:10.095898 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:10.096155 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.096166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.097237 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.097243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.098172 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.098186 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.098924 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.098931 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.099119 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.099718 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:10.099741 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:10.103152 (+ 3411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":296,"threads_started":1}
W20260811 18:55:10.103570 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:10.094548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:43809 (local address 127.19.155.254:46057)
0811 18:55:10.094806 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:10.094813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:10.095137 (+ 324us) server_negotiation.cc:407] Connection header received
0811 18:55:10.095267 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:10.095271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:10.095331 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:10.095408 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:10.096296 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.097085 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.098337 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.098740 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.098882 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.103332 (+ 4450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:43809: BlockingRecv error: recv got EOF from 127.19.155.195:43809 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:10.178663 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:10.170519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:60153)
0811 18:55:10.171082 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:10.171098 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:10.171212 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:10.171661 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:10.171665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:10.172209 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:10.172431 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.172459 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.173475 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.173479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.174369 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.174380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.175053 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.175056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.175180 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.175777 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:10.175795 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:10.178435 (+ 2640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":314,"threads_started":1}
W20260811 18:55:10.178828 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:10.170580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:60153 (local address 127.19.155.254:46057)
0811 18:55:10.170762 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:10.170768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:10.171181 (+ 413us) server_negotiation.cc:407] Connection header received
0811 18:55:10.171365 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:10.171368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:10.171495 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:10.171593 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:10.172600 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.173353 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.174494 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.174935 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.175023 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.178617 (+ 3594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:60153: BlockingRecv error: recv got EOF from 127.19.155.193:60153 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:10 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:10.652653 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:10.644934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:47933)
0811 18:55:10.645467 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:10.645483 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:10.645599 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:10.645896 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:10.645899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:10.646316 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:10.646465 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.646472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.647508 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.647512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.648414 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:10.648425 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.649071 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.649075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:10.649204 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.649775 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:10.649792 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:10.652431 (+ 2639us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":329,"threads_started":1}
W20260811 18:55:10.652915 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:10.644984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:47933 (local address 127.19.155.254:46057)
0811 18:55:10.645219 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:10.645229 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:10.645565 (+ 336us) server_negotiation.cc:407] Connection header received
0811 18:55:10.645704 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:10.645707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:10.645770 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:10.645850 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:10.646583 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.647335 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.648534 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:10.648954 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:10.649045 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:10.652635 (+ 3590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:47933: BlockingRecv error: recv got EOF from 127.19.155.194:47933 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:11.112690 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:11.104504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:40885)
0811 18:55:11.105043 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:11.105059 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:11.105169 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:11.105496 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:11.105499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:11.105876 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:11.106030 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.106038 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.107148 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.107152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.108168 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.108181 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.108895 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.108899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.109038 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.109636 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:11.109653 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:11.112455 (+ 2802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":310,"threads_started":1}
W20260811 18:55:11.112877 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:11.104600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:40885 (local address 127.19.155.254:46057)
0811 18:55:11.104787 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:11.104792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:11.105153 (+ 361us) server_negotiation.cc:407] Connection header received
0811 18:55:11.105262 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:11.105266 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:11.105357 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:11.105441 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:11.106212 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.107008 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.108304 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.108761 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.108861 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.112654 (+ 3793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:40885: BlockingRecv error: recv got EOF from 127.19.155.195:40885 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:11.188436 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:11.179735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:50933)
0811 18:55:11.180292 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:11.180309 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:11.180464 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:11.180818 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:11.180823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:11.181244 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:11.181403 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.181412 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.182410 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.182417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.183402 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.183414 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.184201 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.184208 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.184368 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.185161 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:11.185185 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:11.188194 (+ 3009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":295,"threads_started":1}
W20260811 18:55:11.188620 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:11.179793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:50933 (local address 127.19.155.254:46057)
0811 18:55:11.179998 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:11.180006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:11.180392 (+ 386us) server_negotiation.cc:407] Connection header received
0811 18:55:11.180587 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:11.180592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:11.180678 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:11.180780 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:11.181541 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.182269 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.183555 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.184018 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.184142 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.188372 (+ 4230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:50933: BlockingRecv error: recv got EOF from 127.19.155.193:50933 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:11 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:11.661993 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:11.653532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:32901)
0811 18:55:11.654110 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:11.654136 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:11.654298 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:11.654643 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:11.654648 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:11.655109 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:11.655265 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.655274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.656253 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.656258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.657329 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:11.657342 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.658136 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.658143 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:11.658303 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.658874 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:11.658892 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:11.661751 (+ 2859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":273,"threads_started":1}
W20260811 18:55:11.662194 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:11.653858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:32901 (local address 127.19.155.254:46057)
0811 18:55:11.654066 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:11.654074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:11.654221 (+ 147us) server_negotiation.cc:407] Connection header received
0811 18:55:11.654437 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:11.654444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:11.654508 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:11.654611 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:11.655409 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.656113 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.657478 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:11.657909 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:11.658067 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:11.661945 (+ 3878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:32901: BlockingRecv error: recv got EOF from 127.19.155.194:32901 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:12.122100 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:12.113727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:53583)
0811 18:55:12.114259 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:12.114277 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:12.114439 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:12.114799 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:12.114806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:12.115237 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:12.115393 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.115401 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.116385 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.116397 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.117400 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.117413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.118208 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.118215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.118383 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.119049 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:12.119067 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:12.121740 (+ 2673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":278,"threads_started":1}
W20260811 18:55:12.122166 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:12.113793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:53583 (local address 127.19.155.254:46057)
0811 18:55:12.114022 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:12.114030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:12.114372 (+ 342us) server_negotiation.cc:407] Connection header received
0811 18:55:12.114579 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:12.114586 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:12.114651 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:12.114753 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:12.115534 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.116226 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.117548 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.118022 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.118160 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.121949 (+ 3789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:53583: BlockingRecv error: recv got EOF from 127.19.155.195:53583 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:12.197489 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:12.189426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:48979)
0811 18:55:12.189881 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:12.189896 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:12.190009 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:12.190343 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:12.190346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:12.190705 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:12.190888 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.190925 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.191905 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.191908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.192807 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.192818 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.193483 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.193487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.193602 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.194163 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:12.194179 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:12.197146 (+ 2967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":241,"threads_started":1}
W20260811 18:55:12.197620 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:12.189452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:48979 (local address 127.19.155.254:46057)
0811 18:55:12.189791 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:12.189797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:12.189990 (+ 193us) server_negotiation.cc:407] Connection header received
0811 18:55:12.190141 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:12.190144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:12.190207 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:12.190287 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:12.191021 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.191783 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.192925 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.193358 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.193449 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.197367 (+ 3918us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:48979: BlockingRecv error: recv got EOF from 127.19.155.193:48979 (error 108)
Metrics: {"server-negotiator.queue_time_us":184}
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:12 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:12.676292 3132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:12.663033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:53261)
0811 18:55:12.663521 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:12.663536 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:12.663695 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:12.664023 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:12.664028 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:12.664424 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:12.664597 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.664606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.665586 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.665591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.666455 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:12.666466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.667232 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.667238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:12.667406 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.672576 (+ 5170us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:12.672595 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:12.675939 (+ 3344us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":263,"threads_started":1}
W20260811 18:55:12.676395 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:12.663099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:53261 (local address 127.19.155.254:46057)
0811 18:55:12.663322 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:12.663328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:12.663625 (+ 297us) server_negotiation.cc:407] Connection header received
0811 18:55:12.663819 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:12.663824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:12.663891 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:12.663988 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:12.664742 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.665446 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.666598 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:12.667083 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:12.667209 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:12.676140 (+ 8931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:53261: BlockingRecv error: recv got EOF from 127.19.155.194:53261 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.195@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:13.131366 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:13.123150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.195:53757)
0811 18:55:13.123804 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:13.123823 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:13.123954 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:13.124268 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:13.124272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:13.124647 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:13.124816 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.124823 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.125797 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.125800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.126663 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.126673 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.127353 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.127357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.127474 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.128056 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:13.128073 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:13.131000 (+ 2927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":419,"threads_started":1}
W20260811 18:55:13.131500 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:13.123215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:53757 (local address 127.19.155.254:46057)
0811 18:55:13.123442 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:13.123452 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:13.123925 (+ 473us) server_negotiation.cc:407] Connection header received
0811 18:55:13.124051 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:13.124054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:13.124140 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:13.124219 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:13.124941 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.125669 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.126784 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.127222 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.127317 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.131261 (+ 3944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.195:53757: BlockingRecv error: recv got EOF from 127.19.155.195:53757 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.193@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:13.207418 3136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:13.198852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.193:47309)
0811 18:55:13.199402 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:13.199418 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:13.199565 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:13.199985 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:13.199988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:13.200389 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:13.200556 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.200565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.201574 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.201578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.202490 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.202500 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.203188 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.203192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.203299 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.203837 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:13.203854 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:13.207141 (+ 3287us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":287,"threads_started":1}
W20260811 18:55:13.207616 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:13.198940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:47309 (local address 127.19.155.254:46057)
0811 18:55:13.199169 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:13.199178 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:13.199500 (+ 322us) server_negotiation.cc:407] Connection header received
0811 18:55:13.199739 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:13.199743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:13.199855 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:13.199938 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:13.200680 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.201458 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.202606 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.203068 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.203151 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.207345 (+ 4194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.193:47309: BlockingRecv error: recv got EOF from 127.19.155.193:47309 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:55:13 dist-test-slave-1nl6 krb5kdc[1492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.155.194@KRBTEST.COM for oryx/127.19.155.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:55:13.685393 3139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:13.677563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46057 (local address 127.19.155.194:51613)
0811 18:55:13.678125 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:13.678141 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:13.678249 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:13.678529 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:13.678532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:13.678944 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:13.679111 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.679119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.680089 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.680093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.681009 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:13.681020 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.681704 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.681708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:13.681815 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.682364 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:13.682380 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:13.685130 (+ 2750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.155.254:46057: Server oryx/127.19.155.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":301,"threads_started":1}
W20260811 18:55:13.685529 2638 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:13.677649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:51613 (local address 127.19.155.254:46057)
0811 18:55:13.677829 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:13.677834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:13.678211 (+ 377us) server_negotiation.cc:407] Connection header received
0811 18:55:13.678340 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:13.678344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:13.678403 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:13.678484 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:13.679232 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.679951 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.681141 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.681586 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.681677 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.685300 (+ 3623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.155.194:51613: BlockingRecv error: recv got EOF from 127.19.155.194:51613 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 18:55:13.975158 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2393
I20260811 18:55:13.987936 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:13.976246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49764 (local address 127.19.155.193:36805)
0811 18:55:13.976887 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:13.976904 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:13.976963 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:55:13.977077 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:13.977085 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:13.977414 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:13.977639 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:13.979205 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.980450 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.981669 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:13.982222 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:13.982333 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:13.984907 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:13.984915 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:13.984930 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:13.984963 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:13.987419 (+ 2456us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:55:13.987681 (+ 262us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49764: Request ticket server kudu/127.19.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":323,"threads_started":1}
W20260811 18:55:13.988066 3141 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49764: Request ticket server kudu/127.19.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 18:55:13.988095 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2393: Not authorized: Client connection negotiation failed: client connection to 127.19.155.193:36805: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:55:13.988312 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 2393
I20260811 18:55:14.017441 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2640
I20260811 18:55:14.029577 3142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:14.018519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.19.155.194:39633)
0811 18:55:14.019162 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:14.019170 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:14.019205 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:55:14.019275 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:14.019282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:14.019510 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:14.019694 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:14.020981 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.022100 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.023399 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.023972 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.024075 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:14.026583 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:14.026592 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:14.026607 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:14.026639 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:14.029067 (+ 2428us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:55:14.029326 (+ 259us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58458: Request ticket server kudu/127.19.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":294,"threads_started":1}
W20260811 18:55:14.029754 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2640: Not authorized: Client connection negotiation failed: client connection to 127.19.155.194:39633: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:55:14.029958 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 2640
I20260811 18:55:14.056353 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2856
I20260811 18:55:14.068858 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:14.057442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49718 (local address 127.19.155.195:33893)
0811 18:55:14.058046 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:14.058054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:14.058080 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:55:14.058145 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:14.058152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:14.058384 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:14.058536 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:14.060025 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.061080 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.062265 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.062817 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.062982 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:14.065438 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:14.065446 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:14.065462 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:14.065504 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:14.068237 (+ 2733us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 18:55:14.068564 (+ 327us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49718: Request ticket server kudu/127.19.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":307,"threads_started":1}
W20260811 18:55:14.068971 3143 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49718: Request ticket server kudu/127.19.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 18:55:14.069015 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2856: Not authorized: Client connection negotiation failed: client connection to 127.19.155.195:33893: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.155.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 18:55:14.069200 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 2856
I20260811 18:55:14.102065 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 2270
I20260811 18:55:14.103500 2379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:14.225174 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 2270
2026-08-11T18:55:14Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21634 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T18:55:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:14Z Disabled control of system clock
I20260811 18:55:14.320734 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36673
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:33939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:36673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:55:14.659479 3150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:14.659799 3150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:14.659884 3150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:14.667263 3150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:14.667380 3150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:14.667418 3150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:14.667475 3150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:14.667519 3150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:14.677004 3150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:36673
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:14.678324 3150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:14.680081 3150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:14.692265 3159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:14.692318 3157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:14.692299 3161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:14.692930 3150 server_base.cc:1034] running on GCE node
I20260811 18:55:14.693720 3150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:14.695209 3150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:14.696441 3150 hybrid_clock.cc:648] HybridClock initialized: now 1786474514696391 us; error 57 us; skew 500 ppm
I20260811 18:55:14.696805 3150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:14.699043 3150 webserver.cc:460] Webserver started at http://127.19.155.254:43725/ using document root <none> and password file <none>
I20260811 18:55:14.699733 3150 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:14.699878 3150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:14.700214 3150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:14.703178 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "7ad9b3411f124ee89dfa59bc608a127a"
format_stamp: "Formatted at 2026-08-11 18:55:14 on dist-test-slave-1nl6"
server_key: "828ff73b601d4f1e5b3643e203a262bf"
server_key_iv: "9fff4c530a9b4afc70e7cd76c5db6dab"
server_key_version: "encryptionkey@0"
I20260811 18:55:14.703992 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "7ad9b3411f124ee89dfa59bc608a127a"
format_stamp: "Formatted at 2026-08-11 18:55:14 on dist-test-slave-1nl6"
server_key: "828ff73b601d4f1e5b3643e203a262bf"
server_key_iv: "9fff4c530a9b4afc70e7cd76c5db6dab"
server_key_version: "encryptionkey@0"
I20260811 18:55:14.708976 3150 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:55:14.712494 3168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:14.713892 3150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:55:14.714052 3150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "7ad9b3411f124ee89dfa59bc608a127a"
format_stamp: "Formatted at 2026-08-11 18:55:14 on dist-test-slave-1nl6"
server_key: "828ff73b601d4f1e5b3643e203a262bf"
server_key_iv: "9fff4c530a9b4afc70e7cd76c5db6dab"
server_key_version: "encryptionkey@0"
I20260811 18:55:14.714227 3150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:14.728968 3150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:14.729692 3150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:14.729936 3150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:14.748064 3150 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:36673
I20260811 18:55:14.748091 3257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:36673 every 8 connection(s)
I20260811 18:55:14.749382 3150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:14.753046 3258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:14.754279 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 3150
I20260811 18:55:14.754477 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:55:14.755239 20079 external_mini_cluster.cc:1428] Setting key a8a5dd114a376534711c69c829884895
I20260811 18:55:14.767479 3258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a: Bootstrap starting.
I20260811 18:55:14.769963 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:14.757190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40736 (local address 127.19.155.254:36673)
0811 18:55:14.758328 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:14.758343 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:14.758392 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:55:14.760108 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:14.760138 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:14.760710 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:14.761130 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:14.761701 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.763660 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.764931 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:14.765905 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:14.766099 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:14.767218 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:14.767229 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:14.767246 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:14.767950 (+ 704us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:14.768050 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:14.768076 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:14.768195 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:14.768363 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:55:14.768664 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":347,"threads_started":1}
I20260811 18:55:14.771462 3258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:14.772568 3258 log.cc:824] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:14.775207 3258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a: No bootstrap required, opened a new log
I20260811 18:55:14.782233 3258 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } }
I20260811 18:55:14.782536 3258 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:14.782606 3258 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad9b3411f124ee89dfa59bc608a127a, State: Initialized, Role: FOLLOWER
I20260811 18:55:14.783107 3258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } }
I20260811 18:55:14.783354 3258 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:14.783514 3258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:14.783689 3258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:14.785957 3258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } }
I20260811 18:55:14.786435 3258 leader_election.cc:302] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ad9b3411f124ee89dfa59bc608a127a; no voters:
I20260811 18:55:14.787017 3258 leader_election.cc:288] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:14.787164 3269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:14.787866 3269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad9b3411f124ee89dfa59bc608a127a, State: Running, Role: LEADER
I20260811 18:55:14.788396 3269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } }
I20260811 18:55:14.789032 3258 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:14.790834 3271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ad9b3411f124ee89dfa59bc608a127a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } } }
I20260811 18:55:14.791245 3271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:14.791131 3272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ad9b3411f124ee89dfa59bc608a127a. Latest consensus state: current_term: 1 leader_uuid: "7ad9b3411f124ee89dfa59bc608a127a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad9b3411f124ee89dfa59bc608a127a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36673 } } }
I20260811 18:55:14.791457 3272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:14.793004 3276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:14.798511 3276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:14.807498 3276 catalog_manager.cc:1347] Generated new cluster ID: 4f3126947a9340099c76ec9582b7a1db
I20260811 18:55:14.807616 3276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:14.823544 3276 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:14.824745 3276 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:14.843472 3276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ad9b3411f124ee89dfa59bc608a127a: Generated new TSK 0
I20260811 18:55:14.844269 3276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:55:14.857477 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--builtin_ntp_servers=127.19.155.212:33939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:55:15.208114 3297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:15.208400 3297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:15.208549 3297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:15.216013 3297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:15.216152 3297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:15.216327 3297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:55:15.225515 3297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:15.226809 3297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:15.228616 3297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:15.242075 3309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:15.242204 3306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:15.242329 3303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:15.243043 3297 server_base.cc:1034] running on GCE node
I20260811 18:55:15.243652 3297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:15.244628 3297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:15.245891 3297 hybrid_clock.cc:648] HybridClock initialized: now 1786474515245823 us; error 66 us; skew 500 ppm
I20260811 18:55:15.246217 3297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:15.248412 3297 webserver.cc:460] Webserver started at http://127.19.155.193:41209/ using document root <none> and password file <none>
I20260811 18:55:15.249356 3297 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:15.249495 3297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:15.249926 3297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:15.253239 3297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "9870485b876f4e49a6b47427d9b9031f"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "f92ff58541073c50e558915a7c3df2ae"
server_key_iv: "85700356e2de9ff4c2f60a81524174ec"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.254032 3297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "9870485b876f4e49a6b47427d9b9031f"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "f92ff58541073c50e558915a7c3df2ae"
server_key_iv: "85700356e2de9ff4c2f60a81524174ec"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.259029 3297 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:55:15.262228 3319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.263470 3297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 18:55:15.263652 3297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "9870485b876f4e49a6b47427d9b9031f"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "f92ff58541073c50e558915a7c3df2ae"
server_key_iv: "85700356e2de9ff4c2f60a81524174ec"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.263875 3297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:15.279963 3297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:15.280813 3297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:15.281142 3297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:15.282050 3297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:15.283490 3297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:15.283617 3297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.283740 3297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:15.283828 3297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.317021 3297 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:38491
I20260811 18:55:15.317080 3506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:38491 every 8 connection(s)
I20260811 18:55:15.318394 3297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:15.321311 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 3297
I20260811 18:55:15.321504 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:55:15.322160 20079 external_mini_cluster.cc:1428] Setting key d305dfaf6b2d167acf72bb705617d884
I20260811 18:55:15.325014 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--builtin_ntp_servers=127.19.155.212:33939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:55:15.331357 3509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:15.321041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54561 (local address 127.19.155.254:36673)
0811 18:55:15.321556 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:15.321566 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:15.322977 (+ 1411us) server_negotiation.cc:407] Connection header received
0811 18:55:15.324919 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:15.324924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:15.325017 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:15.325134 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:15.326203 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.326979 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.328551 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.328966 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.329099 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:15.330493 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:15.330498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:15.330501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:15.330519 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:15.330558 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:15.330570 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:15.330666 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:15.330902 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 18:55:15.331016 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260811 18:55:15.332305 3510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:15.321658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36673 (local address 127.19.155.193:54561)
0811 18:55:15.322696 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:15.322749 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:15.324655 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:15.325381 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:15.325389 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:15.325472 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:15.326033 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:15.326051 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.327142 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.327146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:15.328396 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:15.328410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.329190 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.329198 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:15.329429 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:15.330174 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:15.330177 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:15.330214 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:15.330284 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:15.330669 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:15.330683 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:15.330692 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:55:15.330884 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 18:55:15.331275 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":350,"threads_started":1}
I20260811 18:55:15.333752 3507 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36673
I20260811 18:55:15.334045 3507 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:15.334931 3507 heartbeater.cc:511] Master 127.19.155.254:36673 requested a full tablet report, sending...
I20260811 18:55:15.336956 3198 ts_manager.cc:194] Registered new tserver with Master: 9870485b876f4e49a6b47427d9b9031f (127.19.155.193:38491)
I20260811 18:55:15.338443 3198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.193:54561
W20260811 18:55:15.666206 3512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:15.666669 3512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:15.666929 3512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:15.674379 3512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:15.674481 3512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:15.674674 3512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:55:15.683948 3512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:15.685290 3512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:15.687148 3512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:15.700148 3518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:15.700109 3521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:15.700062 3524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:15.701318 3512 server_base.cc:1034] running on GCE node
I20260811 18:55:15.702104 3512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:15.703189 3512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:15.704399 3512 hybrid_clock.cc:648] HybridClock initialized: now 1786474515704343 us; error 48 us; skew 500 ppm
I20260811 18:55:15.704725 3512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:15.707000 3512 webserver.cc:460] Webserver started at http://127.19.155.194:40463/ using document root <none> and password file <none>
I20260811 18:55:15.707712 3512 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:15.707851 3512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:15.708184 3512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:15.711082 3512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "bb91999054fb484bb412e2d84629200a"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "ca26f0fe72a8d081fe5c8b5670f9e94f"
server_key_iv: "6ff5adea23074870fbb55028579373a4"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.711894 3512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "bb91999054fb484bb412e2d84629200a"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "ca26f0fe72a8d081fe5c8b5670f9e94f"
server_key_iv: "6ff5adea23074870fbb55028579373a4"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.717078 3512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:55:15.720434 3538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.721701 3512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:55:15.721889 3512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "bb91999054fb484bb412e2d84629200a"
format_stamp: "Formatted at 2026-08-11 18:55:15 on dist-test-slave-1nl6"
server_key: "ca26f0fe72a8d081fe5c8b5670f9e94f"
server_key_iv: "6ff5adea23074870fbb55028579373a4"
server_key_version: "encryptionkey@0"
I20260811 18:55:15.722115 3512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:15.742578 3512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:15.743542 3512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:15.743862 3512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:15.744843 3512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:15.746308 3512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:15.746443 3512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.746579 3512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:15.746671 3512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:15.781548 3512 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:34143
I20260811 18:55:15.781587 3733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:34143 every 8 connection(s)
I20260811 18:55:15.782856 3512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:15.784130 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 3512
I20260811 18:55:15.784297 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:15.784858 20079 external_mini_cluster.cc:1428] Setting key e00cdad45882faabd476a17c5ad3c365
I20260811 18:55:15.788151 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--builtin_ntp_servers=127.19.155.212:33939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:55:15.796293 3509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:15.786267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:56531 (local address 127.19.155.254:36673)
0811 18:55:15.786466 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:15.786472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:15.787745 (+ 1273us) server_negotiation.cc:407] Connection header received
0811 18:55:15.789645 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:15.789652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:15.789743 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:15.789854 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:15.791065 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.791770 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.793344 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.793746 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.793884 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:15.795430 (+ 1546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:15.795436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:15.795460 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:15.795482 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:15.795524 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:15.795538 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:15.795635 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:15.795871 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 18:55:15.795968 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:55:15.797215 3736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:15.786548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36673 (local address 127.19.155.194:56531)
0811 18:55:15.787595 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:15.787630 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:15.789355 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:15.790143 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:15.790152 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:15.790236 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:15.790847 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:15.790865 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.791948 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.791953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:15.793184 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:15.793197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:15.793997 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:15.794034 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:15.794233 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:15.795048 (+ 815us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:15.795050 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:15.795104 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:15.795219 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:15.795637 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:15.795652 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:15.795661 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:55:15.795839 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 18:55:15.796217 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":392,"threads_started":1}
I20260811 18:55:15.798552 3734 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36673
I20260811 18:55:15.798846 3734 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:15.799778 3734 heartbeater.cc:511] Master 127.19.155.254:36673 requested a full tablet report, sending...
I20260811 18:55:15.801280 3198 ts_manager.cc:194] Registered new tserver with Master: bb91999054fb484bb412e2d84629200a (127.19.155.194:34143)
I20260811 18:55:15.802084 3198 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.194:56531
W20260811 18:55:16.124861 3737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:16.125144 3737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:16.125334 3737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:16.132704 3737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:16.132805 3737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:16.132973 3737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:55:16.145782 3737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:16.147740 3737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:16.150408 3737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:16.163600 3744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:16.163880 3749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:16.163908 3745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:16.164829 3737 server_base.cc:1034] running on GCE node
I20260811 18:55:16.165375 3737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:16.166203 3737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:16.167431 3737 hybrid_clock.cc:648] HybridClock initialized: now 1786474516167397 us; error 32 us; skew 500 ppm
I20260811 18:55:16.167709 3737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:16.170017 3737 webserver.cc:460] Webserver started at http://127.19.155.195:39781/ using document root <none> and password file <none>
I20260811 18:55:16.170642 3737 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:16.170732 3737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:16.171101 3737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:16.173805 3737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "c6feeb40792f4305813efb4f47e8510f"
format_stamp: "Formatted at 2026-08-11 18:55:16 on dist-test-slave-1nl6"
server_key: "5da55272cfd55474ca380c5217044eb8"
server_key_iv: "17648a499c0da09d259b022eaa08d12b"
server_key_version: "encryptionkey@0"
I20260811 18:55:16.174536 3737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "c6feeb40792f4305813efb4f47e8510f"
format_stamp: "Formatted at 2026-08-11 18:55:16 on dist-test-slave-1nl6"
server_key: "5da55272cfd55474ca380c5217044eb8"
server_key_iv: "17648a499c0da09d259b022eaa08d12b"
server_key_version: "encryptionkey@0"
I20260811 18:55:16.179648 3737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 18:55:16.182789 3757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:16.184020 3737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 18:55:16.184175 3737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "c6feeb40792f4305813efb4f47e8510f"
format_stamp: "Formatted at 2026-08-11 18:55:16 on dist-test-slave-1nl6"
server_key: "5da55272cfd55474ca380c5217044eb8"
server_key_iv: "17648a499c0da09d259b022eaa08d12b"
server_key_version: "encryptionkey@0"
I20260811 18:55:16.184357 3737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:16.197474 3737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:16.198354 3737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:16.198670 3737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:16.199723 3737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:16.201156 3737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:16.201287 3737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:16.201433 3737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:16.201530 3737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:16.236271 3737 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:33823
I20260811 18:55:16.236349 3941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:33823 every 8 connection(s)
I20260811 18:55:16.237609 3737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:16.238492 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 3737
I20260811 18:55:16.238680 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:16.239283 20079 external_mini_cluster.cc:1428] Setting key 778f7858e5ff7e5ee01226783d2e6492
I20260811 18:55:16.251210 3509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:16.240393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:39219 (local address 127.19.155.254:36673)
0811 18:55:16.240592 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:16.240597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:16.242367 (+ 1770us) server_negotiation.cc:407] Connection header received
0811 18:55:16.244320 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:16.244325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:16.244412 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:16.244535 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:16.245906 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.246758 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.248341 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.248777 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.248918 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:16.250339 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:16.250345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:16.250350 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:16.250376 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:16.250408 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:16.250420 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:16.250518 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:16.250755 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 18:55:16.250851 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:55:16.252359 3944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:16.241038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36673 (local address 127.19.155.195:39219)
0811 18:55:16.242229 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:16.242279 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:16.244042 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:16.244777 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:16.244785 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:16.244879 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:16.245689 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:16.245713 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.246942 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.246948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:16.248187 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:16.248200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.249013 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.249021 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:16.249283 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:16.250014 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:16.250017 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:16.250060 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:16.250135 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:16.250520 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:16.250534 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:16.250544 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:55:16.250744 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 18:55:16.251159 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":358,"threads_started":1}
I20260811 18:55:16.254220 3942 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36673
I20260811 18:55:16.254581 3942 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:16.255460 3942 heartbeater.cc:511] Master 127.19.155.254:36673 requested a full tablet report, sending...
I20260811 18:55:16.256834 3197 ts_manager.cc:194] Registered new tserver with Master: c6feeb40792f4305813efb4f47e8510f (127.19.155.195:33823)
I20260811 18:55:16.257723 3197 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.195:39219
I20260811 18:55:16.267434 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:55:16.273938 3509 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:16.272267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40750 (local address 127.19.155.254:36673)
0811 18:55:16.272452 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:16.272456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:16.273008 (+ 552us) server_negotiation.cc:407] Connection header received
0811 18:55:16.273143 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:16.273146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:16.273218 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:16.273304 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:16.273654 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40750: BlockingRecv error: recv got EOF from 127.0.0.1:40750 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:55:16.274876 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 3297
I20260811 18:55:16.282397 3951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:16.275783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.19.155.193:38491)
0811 18:55:16.276310 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:16.276317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:16.276343 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:55:16.276408 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:16.276414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:16.276606 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:16.276735 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:16.277076 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.278069 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.279336 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.279895 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.279994 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:16.281037 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:16.281045 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:16.281057 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:16.281615 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:16.281665 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:16.281685 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:16.281775 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:16.281907 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:55:16.282075 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":287,"threads_started":1}
I20260811 18:55:16.283641 3499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:16.363816 3507 heartbeater.cc:503] Master 127.19.155.254:36673 was elected leader, sending a full tablet report...
I20260811 18:55:16.364981 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 3297
W20260811 18:55:16.388940 3169 connection.cc:535] server connection from 127.19.155.193:54561 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:55:16.389796 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 3512
I20260811 18:55:16.398065 3954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:16.390747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44790 (local address 127.19.155.194:34143)
0811 18:55:16.391287 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:16.391302 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:16.391330 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:55:16.391390 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:16.391397 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:16.391612 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:16.391784 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:16.392244 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.393227 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.394478 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.395309 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.395458 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:16.396611 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:16.396620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:16.396634 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:16.397225 (+ 591us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:16.397273 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:16.397293 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:16.397423 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:16.397599 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 18:55:16.397725 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":284,"threads_started":1}
I20260811 18:55:16.399390 3728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:16.481388 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 3512
I20260811 18:55:16.507807 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 3737
I20260811 18:55:16.516017 3957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:16.508837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58702 (local address 127.19.155.195:33823)
0811 18:55:16.509829 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:16.509841 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:16.509882 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:55:16.509969 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:16.509980 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:16.510258 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:16.510396 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:16.510788 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.511855 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.513062 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:16.513601 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:16.513702 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:16.514676 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:16.514684 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:16.514696 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:16.515328 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:16.515373 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:16.515393 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:16.515484 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:16.515609 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 18:55:16.515724 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":540,"threads_started":1}
I20260811 18:55:16.517302 3935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:16.598038 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 3737
I20260811 18:55:16.626595 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 3150
I20260811 18:55:16.627918 3250 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:16.731495 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 3150
2026-08-11T18:55:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2498 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T18:55:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:16Z Disabled control of system clock
I20260811 18:55:16.820165 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40571
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:41253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:40571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:55:17.159204 3965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:17.159566 3965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:17.159741 3965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:17.167788 3965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:17.167920 3965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:17.168023 3965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:17.168154 3965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:17.168210 3965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:17.178258 3965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:40571
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:17.179811 3965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:17.181802 3965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:17.194348 3971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:17.194314 3972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:17.194654 3978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:17.195398 3965 server_base.cc:1034] running on GCE node
I20260811 18:55:17.196216 3965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:17.197695 3965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:17.198990 3965 hybrid_clock.cc:648] HybridClock initialized: now 1786474517198939 us; error 48 us; skew 500 ppm
I20260811 18:55:17.199354 3965 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:17.201676 3965 webserver.cc:460] Webserver started at http://127.19.155.254:46463/ using document root <none> and password file <none>
I20260811 18:55:17.202389 3965 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:17.202484 3965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:17.202765 3965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:17.207824 3965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "179e00944a3cd60f7b73c99aaf084c05"
server_key_iv: "ac8cf993d38ab36f2377fcf5b8dc35c0"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.208681 3965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "179e00944a3cd60f7b73c99aaf084c05"
server_key_iv: "ac8cf993d38ab36f2377fcf5b8dc35c0"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.213917 3965 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:55:17.217244 3988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:17.218501 3965 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:55:17.218715 3965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "179e00944a3cd60f7b73c99aaf084c05"
server_key_iv: "ac8cf993d38ab36f2377fcf5b8dc35c0"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.219018 3965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:17.224731 3965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:17.225507 3965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:17.225831 3965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:17.243786 3965 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:40571
I20260811 18:55:17.243819 4073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:40571 every 8 connection(s)
I20260811 18:55:17.245100 3965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:17.249166 4076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:17.252956 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 3965
I20260811 18:55:17.253168 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:55:17.253823 20079 external_mini_cluster.cc:1428] Setting key 3db42abe6016fc255159e3b08522662f
I20260811 18:55:17.262888 4076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d: Bootstrap starting.
I20260811 18:55:17.266085 4076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:17.267247 4076 log.cc:824] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:17.269694 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:17.256546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41254 (local address 127.19.155.254:40571)
0811 18:55:17.257937 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:17.257952 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:17.258008 (+ 56us) server_negotiation.cc:407] Connection header received
0811 18:55:17.260406 (+ 2398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:17.260436 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:17.260926 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:17.261384 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:17.267834 (+ 6450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:17.267845 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:17.267868 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:17.267893 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:17.267994 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:17.268027 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:17.268259 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:17.268448 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:55:17.268724 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":423,"threads_started":1}
I20260811 18:55:17.270802 4076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d: No bootstrap required, opened a new log
I20260811 18:55:17.278527 4076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } }
I20260811 18:55:17.278855 4076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:17.279017 4076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66820ac3b35d4d4cbed15c3f70d2ce5d, State: Initialized, Role: FOLLOWER
I20260811 18:55:17.279590 4076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } }
I20260811 18:55:17.279837 4076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:17.279994 4076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:17.280186 4076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:17.282667 4076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } }
I20260811 18:55:17.283205 4076 leader_election.cc:302] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66820ac3b35d4d4cbed15c3f70d2ce5d; no voters:
I20260811 18:55:17.283811 4076 leader_election.cc:288] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:17.283977 4083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:17.284772 4083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [term 1 LEADER]: Becoming Leader. State: Replica: 66820ac3b35d4d4cbed15c3f70d2ce5d, State: Running, Role: LEADER
I20260811 18:55:17.285364 4083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } }
I20260811 18:55:17.286113 4076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:17.288663 4085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66820ac3b35d4d4cbed15c3f70d2ce5d. Latest consensus state: current_term: 1 leader_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } } }
I20260811 18:55:17.289971 4085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:17.289999 4084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66820ac3b35d4d4cbed15c3f70d2ce5d" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40571 } } }
I20260811 18:55:17.291340 4084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:17.291512 4093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:17.297217 4093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:17.306559 4093 catalog_manager.cc:1347] Generated new cluster ID: 27991d8f1b7b4143b3d4d9fc826508d8
I20260811 18:55:17.306677 4093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:17.340574 4093 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:17.341094 4093 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:17.352985 4093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66820ac3b35d4d4cbed15c3f70d2ce5d: Generated new TSK 0
I20260811 18:55:17.353964 4093 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:55:17.370311 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--builtin_ntp_servers=127.19.155.212:41253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:55:17.715464 4106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:17.715723 4106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:17.715807 4106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:17.723528 4106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:17.723651 4106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:17.723825 4106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:55:17.732978 4106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:17.734153 4106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:17.735965 4106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:17.748692 4114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:17.748742 4115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:17.748835 4120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:17.749886 4106 server_base.cc:1034] running on GCE node
I20260811 18:55:17.750468 4106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:17.751371 4106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:17.752568 4106 hybrid_clock.cc:648] HybridClock initialized: now 1786474517752528 us; error 32 us; skew 500 ppm
I20260811 18:55:17.752875 4106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:17.760433 4106 webserver.cc:460] Webserver started at http://127.19.155.193:41461/ using document root <none> and password file <none>
I20260811 18:55:17.761130 4106 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:17.761256 4106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:17.761617 4106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:17.764519 4106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "4c4a434f73084feda5f0920e50cb1c96"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "5ae7acc6530c7f7242a254021074468e"
server_key_iv: "6271049d4ff75fe03ff826ac965234bb"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.765316 4106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "4c4a434f73084feda5f0920e50cb1c96"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "5ae7acc6530c7f7242a254021074468e"
server_key_iv: "6271049d4ff75fe03ff826ac965234bb"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.770399 4106 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 18:55:17.773788 4128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:17.775103 4106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:55:17.775275 4106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "4c4a434f73084feda5f0920e50cb1c96"
format_stamp: "Formatted at 2026-08-11 18:55:17 on dist-test-slave-1nl6"
server_key: "5ae7acc6530c7f7242a254021074468e"
server_key_iv: "6271049d4ff75fe03ff826ac965234bb"
server_key_version: "encryptionkey@0"
I20260811 18:55:17.775499 4106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:17.781325 4106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:17.782096 4106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:17.782375 4106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:17.783335 4106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:17.784703 4106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:17.784832 4106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:17.784965 4106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:17.785051 4106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:17.818738 4106 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35301
I20260811 18:55:17.818794 4294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35301 every 8 connection(s)
I20260811 18:55:17.820207 4106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:17.821185 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 4106
I20260811 18:55:17.821411 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:55:17.822273 20079 external_mini_cluster.cc:1428] Setting key 70cd86ec7926555868887e283a5e6ca4
I20260811 18:55:17.826017 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--builtin_ntp_servers=127.19.155.212:41253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 18:55:17.829852 4299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:17.823203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:47195 (local address 127.19.155.254:40571)
0811 18:55:17.823662 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:17.823668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:17.824994 (+ 1326us) server_negotiation.cc:407] Connection header received
0811 18:55:17.827554 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:17.827559 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:17.827612 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:17.827708 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:17.829178 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:17.829182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:17.829186 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:17.829201 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:17.829243 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:17.829256 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:17.829350 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:17.829578 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 18:55:17.829628 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":239,"threads_started":1}
I20260811 18:55:17.831092 4300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:17.823782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40571 (local address 127.19.155.193:47195)
0811 18:55:17.824823 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:17.824893 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:17.827269 (+ 2376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:17.827985 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:17.827998 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:17.828120 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:17.828824 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:17.828830 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:17.828888 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:17.829000 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:17.829358 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:17.829371 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:17.829381 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:55:17.829650 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 18:55:17.829902 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":300,"threads_started":1}
I20260811 18:55:17.832568 4296 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40571
I20260811 18:55:17.832887 4296 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:17.833539 4296 heartbeater.cc:511] Master 127.19.155.254:40571 requested a full tablet report, sending...
I20260811 18:55:17.835753 4011 ts_manager.cc:194] Registered new tserver with Master: 4c4a434f73084feda5f0920e50cb1c96 (127.19.155.193:35301)
W20260811 18:55:18.164690 4302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:18.164976 4302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:18.165162 4302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:18.172570 4302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:18.172663 4302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:18.172875 4302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:55:18.181919 4302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:18.183158 4302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:18.184949 4302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:18.198199 4311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:18.198169 4313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:18.198441 4310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:18.199239 4302 server_base.cc:1034] running on GCE node
I20260811 18:55:18.199832 4302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:18.200738 4302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:18.201962 4302 hybrid_clock.cc:648] HybridClock initialized: now 1786474518201905 us; error 47 us; skew 500 ppm
I20260811 18:55:18.202273 4302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:18.204550 4302 webserver.cc:460] Webserver started at http://127.19.155.194:36893/ using document root <none> and password file <none>
I20260811 18:55:18.205222 4302 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:18.205387 4302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:18.205719 4302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:18.208565 4302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "1f21650298fc471187fe86aaf7dedc36"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "b6524a4ee763a0c93ace5e37e5663f8a"
server_key_iv: "67c5a13cba824297fdc30b2350f02b8f"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.209362 4302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "1f21650298fc471187fe86aaf7dedc36"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "b6524a4ee763a0c93ace5e37e5663f8a"
server_key_iv: "67c5a13cba824297fdc30b2350f02b8f"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.214423 4302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 18:55:18.217907 4322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.219406 4302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:18.219592 4302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "1f21650298fc471187fe86aaf7dedc36"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "b6524a4ee763a0c93ace5e37e5663f8a"
server_key_iv: "67c5a13cba824297fdc30b2350f02b8f"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.219815 4302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:18.225457 4302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:18.226233 4302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:18.226509 4302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:18.227458 4302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:18.228842 4302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:18.228971 4302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.229095 4302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:18.229184 4302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.265600 4302 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:33973
I20260811 18:55:18.265654 4495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:33973 every 8 connection(s)
I20260811 18:55:18.267017 4302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:18.275058 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 4302
I20260811 18:55:18.275265 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:18.275694 4299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.269746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:40117 (local address 127.19.155.254:40571)
0811 18:55:18.269966 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.269972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.271621 (+ 1649us) server_negotiation.cc:407] Connection header received
0811 18:55:18.273388 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.273395 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.273479 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.273609 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.274895 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:18.274919 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:18.274923 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:18.274944 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:18.274988 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:18.275001 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:18.275157 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:18.275353 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 18:55:18.275430 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 18:55:18.275713 20079 external_mini_cluster.cc:1428] Setting key 9c786064cd498ae310e4741dcf4c15a0
I20260811 18:55:18.276736 4499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.270400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40571 (local address 127.19.155.194:40117)
0811 18:55:18.271457 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:18.271502 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:18.273092 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:18.273857 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:18.273864 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:18.273951 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:18.274560 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:18.274562 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:18.274599 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:18.274714 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:18.275106 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:18.275119 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:18.275128 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:55:18.275437 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 18:55:18.275696 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":326,"threads_started":1}
I20260811 18:55:18.278295 4496 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40571
I20260811 18:55:18.278594 4496 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:18.279035 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--builtin_ntp_servers=127.19.155.212:41253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 18:55:18.279506 4496 heartbeater.cc:511] Master 127.19.155.254:40571 requested a full tablet report, sending...
I20260811 18:55:18.281159 4010 ts_manager.cc:194] Registered new tserver with Master: 1f21650298fc471187fe86aaf7dedc36 (127.19.155.194:33973)
W20260811 18:55:18.614547 4500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:18.614881 4500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:18.615089 4500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:18.622215 4500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:18.622352 4500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:18.622524 4500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:55:18.631621 4500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:18.632941 4500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:18.634689 4500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:18.647156 4506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:18.647197 4508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:18.647218 4505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:18.648281 4500 server_base.cc:1034] running on GCE node
I20260811 18:55:18.648928 4500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:18.649868 4500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:18.651087 4500 hybrid_clock.cc:648] HybridClock initialized: now 1786474518651050 us; error 54 us; skew 500 ppm
I20260811 18:55:18.651397 4500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:55:18.653683 4500 webserver.cc:460] Webserver started at http://127.19.155.195:44511/ using document root <none> and password file <none>
I20260811 18:55:18.654342 4500 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:18.654487 4500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:18.654814 4500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:18.657665 4500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "064fe48a1d5d4094aea80d0049be1245"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "3a2e3abd016edb2b1ec9d34ff4b7bbbf"
server_key_iv: "6f0f0dd050c36116d43e7e1c71cb0e0b"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.658479 4500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "064fe48a1d5d4094aea80d0049be1245"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "3a2e3abd016edb2b1ec9d34ff4b7bbbf"
server_key_iv: "6f0f0dd050c36116d43e7e1c71cb0e0b"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.663473 4500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:55:18.666625 4517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.667903 4500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:18.668087 4500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "064fe48a1d5d4094aea80d0049be1245"
format_stamp: "Formatted at 2026-08-11 18:55:18 on dist-test-slave-1nl6"
server_key: "3a2e3abd016edb2b1ec9d34ff4b7bbbf"
server_key_iv: "6f0f0dd050c36116d43e7e1c71cb0e0b"
server_key_version: "encryptionkey@0"
I20260811 18:55:18.668323 4500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:18.674587 4500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:18.675493 4500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:18.675776 4500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:18.676738 4500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:18.678095 4500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:18.678231 4500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.678357 4500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:18.678453 4500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:18.712075 4500 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:34985
I20260811 18:55:18.712165 4700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:34985 every 8 connection(s)
I20260811 18:55:18.713418 4500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:18.718042 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 4500
I20260811 18:55:18.718227 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:18.718803 20079 external_mini_cluster.cc:1428] Setting key 100410972b44f10134e3f965de9d9195
I20260811 18:55:18.722389 4299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.715954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59653 (local address 127.19.155.254:40571)
0811 18:55:18.716133 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.716137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.717495 (+ 1358us) server_negotiation.cc:407] Connection header received
0811 18:55:18.719835 (+ 2340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.719842 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.719918 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.720028 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.721472 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:18.721479 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:18.721483 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:18.721503 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:18.721541 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:18.721553 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:18.721695 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:18.722113 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 18:55:18.722174 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:55:18.723448 4705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.716471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40571 (local address 127.19.155.195:59653)
0811 18:55:18.717353 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:18.717387 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:18.719576 (+ 2189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:18.720305 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:18.720317 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:18.720434 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:18.721179 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:55:18.721181 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:18.721219 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:55:18.721300 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:18.721887 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:18.721897 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:18.721904 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:55:18.722158 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 18:55:18.722360 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":255,"threads_started":1}
I20260811 18:55:18.724797 4701 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40571
I20260811 18:55:18.725090 4701 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:18.725663 4701 heartbeater.cc:511] Master 127.19.155.254:40571 requested a full tablet report, sending...
I20260811 18:55:18.727011 4010 ts_manager.cc:194] Registered new tserver with Master: 064fe48a1d5d4094aea80d0049be1245 (127.19.155.195:34985)
I20260811 18:55:18.733989 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:55:18.739926 4299 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:18.738405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33094 (local address 127.19.155.254:40571)
0811 18:55:18.738607 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.738615 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.739084 (+ 469us) server_negotiation.cc:407] Connection header received
0811 18:55:18.739224 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.739228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.739275 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.739360 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.739692 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33094: BlockingRecv error: recv got EOF from 127.0.0.1:33094 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 18:55:18.740823 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 4106
I20260811 18:55:18.744072 4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.741741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46226 (local address 127.19.155.193:35301)
0811 18:55:18.742255 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.742261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.742287 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:55:18.742343 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.742348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.742518 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.742635 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.743514 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:18.743521 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:18.743532 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:18.743544 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:18.743589 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:18.743610 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:18.743712 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:18.743789 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:55:18.743870 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":262,"threads_started":1}
I20260811 18:55:18.745159 4287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:18.824456 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 4106
I20260811 18:55:18.855525 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 4302
I20260811 18:55:18.859215 4715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.856571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53506 (local address 127.19.155.194:33973)
0811 18:55:18.857119 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.857126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.857153 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:55:18.857236 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.857243 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.857478 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.857604 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.858487 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:18.858494 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:18.858506 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:18.858527 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:18.858571 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:18.858586 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:18.858690 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:18.858790 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:55:18.858936 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":282,"threads_started":1}
I20260811 18:55:18.860432 4485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:18.940407 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 4302
I20260811 18:55:18.964414 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 4500
I20260811 18:55:18.968526 4717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:18.965445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57328 (local address 127.19.155.195:34985)
0811 18:55:18.966064 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:18.966090 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:18.966121 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:55:18.966183 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:18.966190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:18.966431 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:18.966600 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:18.967769 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:18.967775 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:18.967786 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:55:18.967803 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:18.967843 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:55:18.967856 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:18.968038 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:18.968115 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:55:18.968216 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":309,"threads_started":1}
I20260811 18:55:18.969720 4692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:19.049847 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 4500
I20260811 18:55:19.075256 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 3965
I20260811 18:55:19.076459 4066 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:19.177393 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 3965
2026-08-11T18:55:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2445 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:19 dist-test-slave-1nl6 krb5kdc[4726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:19 dist-test-slave-1nl6 krb5kdc[4726](info): set up 2 sockets
Aug 11 18:55:19 dist-test-slave-1nl6 krb5kdc[4726](info): commencing operation
krb5kdc: starting...
W20260811 18:55:20.504069 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:55:20 dist-test-slave-1nl6 krb5kdc[4726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:55:20.768496 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:33901
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:33901
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:21.105715 4748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:21.105997 4748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:21.106160 4748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:21.113001 4748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:21.113093 4748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:21.113225 4748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:21.113328 4748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:21.113417 4748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:21.122807 4748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:33901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:33901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:21.124044 4748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:21.125344 4748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:21.137037 4757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:21.137143 4763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:21.137079 4754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:21.138126 4748 server_base.cc:1034] running on GCE node
I20260811 18:55:21.139041 4748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:21.140471 4748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:21.141716 4748 hybrid_clock.cc:648] HybridClock initialized: now 1786474521141660 us; error 58 us; skew 500 ppm
I20260811 18:55:21.142071 4748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:55:21 dist-test-slave-1nl6 krb5kdc[4726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474521, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:21.145334 4748 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:55:21.146726 4748 webserver.cc:460] Webserver started at http://127.19.155.254:38289/ using document root <none> and password file <none>
I20260811 18:55:21.147465 4748 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:21.147621 4748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:21.147940 4748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:21.150866 4748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "c0fe84987243404ea51715399dca8262"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "de04965a60c1dc23dba1625f184de59d"
server_key_iv: "f21276b30ff58e8574325b250b59ae49"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.151718 4748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "c0fe84987243404ea51715399dca8262"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "de04965a60c1dc23dba1625f184de59d"
server_key_iv: "f21276b30ff58e8574325b250b59ae49"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.156868 4748 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:55:21.160250 4772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:21.161464 4748 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:55:21.161664 4748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "c0fe84987243404ea51715399dca8262"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "de04965a60c1dc23dba1625f184de59d"
server_key_iv: "f21276b30ff58e8574325b250b59ae49"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.161866 4748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:21.181299 4748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:21.185177 4748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:21.185473 4748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:21.203967 4748 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:33901
I20260811 18:55:21.204005 4857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:33901 every 8 connection(s)
I20260811 18:55:21.205273 4748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:21.205976 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 4748
I20260811 18:55:21.206257 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:55:21.207103 20079 external_mini_cluster.cc:1428] Setting key f42ebc704aebf609f18b48753267cfb7
I20260811 18:55:21.209781 4858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:55:21 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:55:21.222518 4858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: Bootstrap starting.
I20260811 18:55:21.226593 4858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:21.227866 4858 log.cc:824] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:21.231257 4858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: No bootstrap required, opened a new log
I20260811 18:55:21.231614 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:21.209155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49896 (local address 127.19.155.254:33901)
0811 18:55:21.209984 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:21.209999 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:21.210066 (+ 67us) server_negotiation.cc:407] Connection header received
0811 18:55:21.212412 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:21.212440 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:21.212922 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:21.213337 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:21.214686 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.216730 (+ 2044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.218147 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.219230 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.219423 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:21.223311 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:21.223321 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:21.223338 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:21.223377 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:21.227342 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:21.227980 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:21.227989 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:21.227996 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:21.228185 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:21.228660 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:21.228670 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:21.228677 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:21.229218 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:21.229511 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:21.229893 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 18:55:21.230326 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":329,"threads_started":1}
I20260811 18:55:21.239040 4858 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } }
I20260811 18:55:21.239522 4858 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:21.239630 4858 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fe84987243404ea51715399dca8262, State: Initialized, Role: FOLLOWER
I20260811 18:55:21.240198 4858 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } }
I20260811 18:55:21.240445 4858 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:21.240578 4858 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:21.240751 4858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:21.242868 4858 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } }
I20260811 18:55:21.243441 4858 leader_election.cc:302] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0fe84987243404ea51715399dca8262; no voters:
I20260811 18:55:21.243994 4858 leader_election.cc:288] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:21.244127 4865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:21.244899 4865 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [term 1 LEADER]: Becoming Leader. State: Replica: c0fe84987243404ea51715399dca8262, State: Running, Role: LEADER
I20260811 18:55:21.245518 4865 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } }
I20260811 18:55:21.246078 4858 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:21.248554 4869 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0fe84987243404ea51715399dca8262. Latest consensus state: current_term: 1 leader_uuid: "c0fe84987243404ea51715399dca8262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } } }
I20260811 18:55:21.248584 4867 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0fe84987243404ea51715399dca8262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0fe84987243404ea51715399dca8262" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33901 } } }
I20260811 18:55:21.249045 4869 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:21.249049 4867 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262 [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:21.251595 4875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:21.256343 4875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:21.264973 4875 catalog_manager.cc:1347] Generated new cluster ID: d46552c8e1fa43b588667078e2ff2342
I20260811 18:55:21.265080 4875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:21.278582 4875 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:21.280380 4875 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:21.289978 4875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: Generated new TSK 0
I20260811 18:55:21.290957 4875 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:55:21.360813 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:21.698452 4902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:21.698762 4902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:21.698957 4902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:21.705930 4902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:21.706107 4902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:21.706282 4902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:55:21.716835 4902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:21.718132 4902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:21.719671 4902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:21.733283 4911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:21.733374 4910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:21.733397 4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:21.734164 4902 server_base.cc:1034] running on GCE node
I20260811 18:55:21.734691 4902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:21.735610 4902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:21.736811 4902 hybrid_clock.cc:648] HybridClock initialized: now 1786474521736776 us; error 29 us; skew 500 ppm
I20260811 18:55:21.737082 4902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:55:21 dist-test-slave-1nl6 krb5kdc[4726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474521, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:21.740159 4902 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:55:21.741539 4902 webserver.cc:460] Webserver started at http://127.19.155.193:34621/ using document root <none> and password file <none>
I20260811 18:55:21.742151 4902 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:21.742255 4902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:21.742527 4902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:21.745365 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "9dd0bbac9a4942c398f626ec566635ff"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "84d52ebe649f4f7f40e4f97d966b75c7"
server_key_iv: "74ddbd1ada017aa7e90509c86c63e9ac"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.746163 4902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "9dd0bbac9a4942c398f626ec566635ff"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "84d52ebe649f4f7f40e4f97d966b75c7"
server_key_iv: "74ddbd1ada017aa7e90509c86c63e9ac"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.751376 4902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 18:55:21.754637 4922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:21.755964 4902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:21.756142 4902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "9dd0bbac9a4942c398f626ec566635ff"
format_stamp: "Formatted at 2026-08-11 18:55:21 on dist-test-slave-1nl6"
server_key: "84d52ebe649f4f7f40e4f97d966b75c7"
server_key_iv: "74ddbd1ada017aa7e90509c86c63e9ac"
server_key_version: "encryptionkey@0"
I20260811 18:55:21.756330 4902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:21.770447 4902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:21.774315 4902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:21.774631 4902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:21.775588 4902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:21.776919 4902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:21.776994 4902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:21.777161 4902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:21.777228 4902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:21.811103 4902 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40727
I20260811 18:55:21.811141 5094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40727 every 8 connection(s)
I20260811 18:55:21.812439 4902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:21.819037 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 4902
I20260811 18:55:21.819270 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:55:21.819928 20079 external_mini_cluster.cc:1428] Setting key aeff04944eb565556aced357bc415fed
Aug 11 18:55:21 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474521, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:55:21.834820 5103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:21.814996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:48497 (local address 127.19.155.254:33901)
0811 18:55:21.815464 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:21.815469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:21.816267 (+ 798us) server_negotiation.cc:407] Connection header received
0811 18:55:21.818104 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:21.818110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:21.818203 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:21.818326 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:21.820052 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.820943 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.823128 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.823543 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.823653 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:21.827965 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:21.827974 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:21.827982 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:21.828027 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:21.831568 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:21.832306 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:21.832314 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:21.832320 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:21.832479 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:21.832894 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:21.832902 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:21.832908 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:21.833275 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:21.833435 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:21.834093 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 18:55:21.834368 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":244,"threads_started":1}
I20260811 18:55:21.835500 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:21.815396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:33901 (local address 127.19.155.193:48497)
0811 18:55:21.816107 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:21.816150 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:21.817815 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:21.818571 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:21.818580 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:21.819267 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:21.819873 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:21.819892 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.821113 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.821117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:21.822953 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:21.822972 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:21.823781 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:21.823791 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:21.824124 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:21.824864 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:21.824898 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:21.827725 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:21.831726 (+ 4001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:21.831733 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:21.831744 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:21.832167 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:21.832587 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:21.832591 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:21.832593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:21.832776 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:21.833418 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:21.833423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:21.833715 (+ 292us) client_negotiation.cc:769] Sending connection context
0811 18:55:21.833928 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 18:55:21.834294 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":270,"threads_started":1}
I20260811 18:55:21.837064 5096 heartbeater.cc:347] Connected to a master server at 127.19.155.254:33901
I20260811 18:55:21.837395 5096 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:21.838268 5096 heartbeater.cc:511] Master 127.19.155.254:33901 requested a full tablet report, sending...
I20260811 18:55:21.840534 4800 ts_manager.cc:194] Registered new tserver with Master: 9dd0bbac9a4942c398f626ec566635ff (127.19.155.193:40727)
I20260811 18:55:21.841957 4800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:48497
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:55:21.882715 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:22.216984 5107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:22.217306 5107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:22.217481 5107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:22.224704 5107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:22.224848 5107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:22.225024 5107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:55:22.234462 5107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:22.235754 5107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:22.237030 5107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:22.250342 5116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:22.250483 5119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:22.250859 5115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:22.251286 5107 server_base.cc:1034] running on GCE node
I20260811 18:55:22.251859 5107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:22.252779 5107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:22.254042 5107 hybrid_clock.cc:648] HybridClock initialized: now 1786474522253993 us; error 58 us; skew 500 ppm
I20260811 18:55:22.254357 5107 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:55:22 dist-test-slave-1nl6 krb5kdc[4726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:22.257681 5107 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:55:22.259095 5107 webserver.cc:460] Webserver started at http://127.19.155.194:35553/ using document root <none> and password file <none>
I20260811 18:55:22.259805 5107 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:22.259977 5107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:22.260306 5107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:22.263332 5107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "86ceb39f5da0463792c73ce5364dce8f"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "19bfe099fe603a56d9098b0b6563a11a"
server_key_iv: "be0b91a1bd9bf8da004801767e3d60db"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.264099 5107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "86ceb39f5da0463792c73ce5364dce8f"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "19bfe099fe603a56d9098b0b6563a11a"
server_key_iv: "be0b91a1bd9bf8da004801767e3d60db"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.269047 5107 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:55:22.272255 5129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.273453 5107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 18:55:22.273578 5107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "86ceb39f5da0463792c73ce5364dce8f"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "19bfe099fe603a56d9098b0b6563a11a"
server_key_iv: "be0b91a1bd9bf8da004801767e3d60db"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.273726 5107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:22.291230 5107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:22.295444 5107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:22.295691 5107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:22.296520 5107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:22.297745 5107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:22.297817 5107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.297916 5107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:22.297960 5107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.331758 5107 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:45521
I20260811 18:55:22.331802 5299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:45521 every 8 connection(s)
I20260811 18:55:22.333093 5107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:22.339104 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 5107
I20260811 18:55:22.339318 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:22.339740 20079 external_mini_cluster.cc:1428] Setting key 3395cab3d44a107cf323a1214f498b30
Aug 11 18:55:22 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:55:22.354146 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.335950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:60163 (local address 127.19.155.254:33901)
0811 18:55:22.336444 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.336450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.337355 (+ 905us) server_negotiation.cc:407] Connection header received
0811 18:55:22.339193 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.339200 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.339290 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.339417 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:22.340957 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.341736 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.343396 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.343797 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.343943 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.347545 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:22.347553 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:22.347560 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:22.347603 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:22.351163 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.351848 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.351856 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.351862 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.352032 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.352468 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.352475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.352481 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.352843 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:22.352995 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.353630 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.353871 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":234,"threads_started":1}
I20260811 18:55:22.355245 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.336456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:33901 (local address 127.19.155.194:60163)
0811 18:55:22.337185 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:22.337222 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:22.338858 (+ 1636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:22.339666 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:22.339674 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:22.340249 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:22.340780 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.340798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.341901 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.341906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.343252 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.343265 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.344036 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.344043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.344273 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.345025 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:22.345046 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:22.347299 (+ 2253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:22.351294 (+ 3995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:22.351301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:22.351312 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:22.351720 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:22.352146 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:22.352149 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:22.352152 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:22.352343 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:22.352961 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:22.352966 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:22.353255 (+ 289us) client_negotiation.cc:769] Sending connection context
0811 18:55:22.353486 (+ 231us) client_negotiation.cc:240] Negotiation successful
0811 18:55:22.353821 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":270,"threads_started":1}
I20260811 18:55:22.356592 5300 heartbeater.cc:347] Connected to a master server at 127.19.155.254:33901
I20260811 18:55:22.356884 5300 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:22.357555 5300 heartbeater.cc:511] Master 127.19.155.254:33901 requested a full tablet report, sending...
I20260811 18:55:22.359032 4800 ts_manager.cc:194] Registered new tserver with Master: 86ceb39f5da0463792c73ce5364dce8f (127.19.155.194:45521)
I20260811 18:55:22.359916 4800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:60163
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:55:22.402261 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:22.742178 5317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:22.742460 5317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:22.742556 5317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:22.749819 5317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:22.749925 5317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:22.750041 5317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:55:22.759407 5317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:33901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:55:22.760603 5317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:22.761974 5317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:22.775166 5323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:22.775218 5326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:22.775254 5322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:22.775979 5317 server_base.cc:1034] running on GCE node
I20260811 18:55:22.776684 5317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:22.777559 5317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:22.778793 5317 hybrid_clock.cc:648] HybridClock initialized: now 1786474522778753 us; error 48 us; skew 500 ppm
I20260811 18:55:22.779162 5317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:55:22 dist-test-slave-1nl6 krb5kdc[4726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:22.785838 5317 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:55:22.787362 5317 webserver.cc:460] Webserver started at http://127.19.155.195:42707/ using document root <none> and password file <none>
I20260811 18:55:22.787962 5317 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:22.788060 5317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:22.788332 5317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:22.791199 5317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "2a048a1876fe4765b6be9bcc11a2a433"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "bba46d14b23dc71b86b5e825193cf014"
server_key_iv: "1947e6d08ac1e8f7630738f336686af7"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.791936 5317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "2a048a1876fe4765b6be9bcc11a2a433"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "bba46d14b23dc71b86b5e825193cf014"
server_key_iv: "1947e6d08ac1e8f7630738f336686af7"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.796871 5317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:55:22.800129 5339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.801405 5317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:55:22.801538 5317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "2a048a1876fe4765b6be9bcc11a2a433"
format_stamp: "Formatted at 2026-08-11 18:55:22 on dist-test-slave-1nl6"
server_key: "bba46d14b23dc71b86b5e825193cf014"
server_key_iv: "1947e6d08ac1e8f7630738f336686af7"
server_key_version: "encryptionkey@0"
I20260811 18:55:22.801698 5317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:22.824378 5317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:22.828094 5317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:22.828341 5317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:22.829181 5317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:22.830451 5317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:22.830543 5317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.830699 5317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:22.830772 5317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:22.845623 5096 heartbeater.cc:503] Master 127.19.155.254:33901 was elected leader, sending a full tablet report...
I20260811 18:55:22.865228 5317 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:44205
I20260811 18:55:22.865250 5529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:44205 every 8 connection(s)
I20260811 18:55:22.866671 5317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:22.868150 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 5317
I20260811 18:55:22.868353 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:22.868801 20079 external_mini_cluster.cc:1428] Setting key 918e473e9817ed31ac9fc20f3316da3e
Aug 11 18:55:22 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:55:22.887691 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.869492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:60125 (local address 127.19.155.254:33901)
0811 18:55:22.870072 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.870079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.871368 (+ 1289us) server_negotiation.cc:407] Connection header received
0811 18:55:22.873433 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.873439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.873525 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.873668 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:22.875254 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.876037 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.877655 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.878077 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.878224 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.881758 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:22.881770 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:22.881774 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:22.881807 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:22.884999 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.885679 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.885683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.885686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.885803 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.886180 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.886184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.886185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.886439 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:22.886558 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.887269 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.887441 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":295,"threads_started":1}
I20260811 18:55:22.888603 5533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.870170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:33901 (local address 127.19.155.195:60125)
0811 18:55:22.871212 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:22.871266 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:22.873157 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:22.873899 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:22.873908 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:22.874424 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:22.875073 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.875094 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.876219 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.876224 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.877505 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.877518 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.878330 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.878338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.878649 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.879310 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:22.879334 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:22.881538 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:22.885119 (+ 3581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:22.885126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:22.885138 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:22.885570 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:22.885895 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:22.885899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:22.885901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:22.886083 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:22.886549 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:22.886555 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:22.886853 (+ 298us) client_negotiation.cc:769] Sending connection context
0811 18:55:22.887156 (+ 303us) client_negotiation.cc:240] Negotiation successful
0811 18:55:22.887543 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":431,"threads_started":1}
I20260811 18:55:22.889941 5530 heartbeater.cc:347] Connected to a master server at 127.19.155.254:33901
I20260811 18:55:22.890254 5530 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:22.891024 5530 heartbeater.cc:511] Master 127.19.155.254:33901 requested a full tablet report, sending...
I20260811 18:55:22.892432 4800 ts_manager.cc:194] Registered new tserver with Master: 2a048a1876fe4765b6be9bcc11a2a433 (127.19.155.195:44205)
I20260811 18:55:22.893203 4800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:60125
I20260811 18:55:22.896623 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:22.913221 5532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.900974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.19.155.254:33901)
0811 18:55:22.901173 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.901179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.901550 (+ 371us) server_negotiation.cc:407] Connection header received
0811 18:55:22.901737 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.901742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.901816 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.901916 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:22.903386 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.904085 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.905394 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.905891 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.906021 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.908194 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:22.908213 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:22.908216 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:22.908246 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:22.910499 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.911246 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.911251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.911255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.911375 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:22.911767 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:22.911772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:22.911775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:22.912075 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:22.912377 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.912698 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.912920 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:55:22.917521 4800 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49902:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:55:22.924431 4800 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:55:22.947122 5557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.937652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46724 (local address 127.19.155.194:45521)
0811 18:55:22.939201 (+ 1549us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.939206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.939229 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:55:22.939312 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.939317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.939486 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.939687 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:22.940546 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.942083 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.944777 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.946030 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.946187 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.946354 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.946637 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.946793 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1429,"thread_start_us":1290,"threads_started":1}
I20260811 18:55:22.947165 5556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.936939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45521 (local address 127.0.0.1:46724)
0811 18:55:22.938119 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:22.938135 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:22.938239 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:22.939688 (+ 1449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:22.939695 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:22.939722 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:22.940312 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.940326 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.942252 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.942258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.944593 (+ 2335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.944616 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.946211 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.946218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.946396 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.946445 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:55:22.946575 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:55:22.946747 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1057,"thread_start_us":3104,"threads_started":1}
I20260811 18:55:22.947916 5551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.936428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40727 (local address 127.0.0.1:36340)
0811 18:55:22.937238 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:22.937286 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:22.937436 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:22.941294 (+ 3858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:22.941299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:22.941323 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:22.941731 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.941747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.943217 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.943225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.945303 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.945318 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.947085 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.947091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.947276 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.947309 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:55:22.947373 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:55:22.947507 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":24,"thread_start_us":431,"threads_started":1}
I20260811 18:55:22.948783 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.938187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.19.155.195:44205)
0811 18:55:22.939001 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.939010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.940802 (+ 1792us) server_negotiation.cc:407] Connection header received
0811 18:55:22.941067 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.941076 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.941280 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.941463 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:22.942196 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.943884 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.946031 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.947405 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.947627 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.947775 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.948357 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.948520 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":428,"threads_started":1}
I20260811 18:55:22.949286 5555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.937622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44205 (local address 127.0.0.1:44554)
0811 18:55:22.940403 (+ 2781us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:22.940422 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:22.940866 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:22.941590 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:22.941597 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:22.941628 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:22.942030 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.942039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.944059 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.944065 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.945858 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:22.945872 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.947936 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.947943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:22.948095 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.948124 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 18:55:22.948205 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:55:22.949036 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2637,"mutex_wait_us":1,"thread_start_us":860,"threads_started":1}
I20260811 18:55:22.951537 5554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:22.936552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36340 (local address 127.19.155.193:40727)
0811 18:55:22.940663 (+ 4111us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:22.940671 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:22.940700 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:55:22.940811 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:22.940818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:22.941031 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:22.941305 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:22.941944 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.943086 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.945468 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:22.946847 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:22.951049 (+ 4202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:22.951161 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:22.951210 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 18:55:22.951312 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3950,"thread_start_us":4457,"threads_started":1}
I20260811 18:55:22.951189 5209 tablet_service.cc:1467] Processing CreateTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee (DEFAULT_TABLE table=test-table [id=274e352496884cbdaeda77d77926a1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:22.952708 5209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76c054eb87e443469ff5e0b6f8d676ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:22.952860 5421 tablet_service.cc:1467] Processing CreateTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee (DEFAULT_TABLE table=test-table [id=274e352496884cbdaeda77d77926a1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:22.954221 5421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76c054eb87e443469ff5e0b6f8d676ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:22.957420 5001 tablet_service.cc:1467] Processing CreateTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee (DEFAULT_TABLE table=test-table [id=274e352496884cbdaeda77d77926a1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:22.958616 5001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76c054eb87e443469ff5e0b6f8d676ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:22.967504 5562 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Bootstrap starting.
I20260811 18:55:22.969691 5566 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Bootstrap starting.
I20260811 18:55:22.971635 5567 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Bootstrap starting.
I20260811 18:55:22.972528 5562 tablet_bootstrap.cc:654] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:22.973246 5566 tablet_bootstrap.cc:654] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:22.973587 5562 log.cc:824] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:22.974481 5566 log.cc:824] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:22.975219 5567 tablet_bootstrap.cc:654] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:22.976512 5567 log.cc:824] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:22.977357 5562 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: No bootstrap required, opened a new log
I20260811 18:55:22.977380 5566 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: No bootstrap required, opened a new log
I20260811 18:55:22.977670 5562 ts_tablet_manager.cc:1397] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260811 18:55:22.977674 5566 ts_tablet_manager.cc:1397] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260811 18:55:22.979509 5567 tablet_bootstrap.cc:492] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: No bootstrap required, opened a new log
I20260811 18:55:22.979753 5567 ts_tablet_manager.cc:1397] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 18:55:22.984812 5562 raft_consensus.cc:348] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.985380 5562 raft_consensus.cc:374] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:22.985546 5562 raft_consensus.cc:729] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ceb39f5da0463792c73ce5364dce8f, State: Initialized, Role: FOLLOWER
I20260811 18:55:22.986202 5562 consensus_queue.cc:260] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.987332 5300 heartbeater.cc:503] Master 127.19.155.254:33901 was elected leader, sending a full tablet report...
I20260811 18:55:22.988004 5562 ts_tablet_manager.cc:1428] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260811 18:55:22.988256 5566 raft_consensus.cc:348] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.988658 5566 raft_consensus.cc:374] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:22.988795 5566 raft_consensus.cc:729] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a048a1876fe4765b6be9bcc11a2a433, State: Initialized, Role: FOLLOWER
I20260811 18:55:22.989389 5566 consensus_queue.cc:260] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.990217 5567 raft_consensus.cc:348] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.990487 5530 heartbeater.cc:503] Master 127.19.155.254:33901 was elected leader, sending a full tablet report...
I20260811 18:55:22.990660 5567 raft_consensus.cc:374] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:22.990787 5567 raft_consensus.cc:729] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd0bbac9a4942c398f626ec566635ff, State: Initialized, Role: FOLLOWER
I20260811 18:55:22.991209 5566 ts_tablet_manager.cc:1428] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Time spent starting tablet: real 0.013s user 0.012s sys 0.003s
I20260811 18:55:22.991506 5567 consensus_queue.cc:260] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:22.993189 5567 ts_tablet_manager.cc:1428] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
W20260811 18:55:23.064795 5097 tablet.cc:2369] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:23.066768 5574 raft_consensus.cc:482] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:23.067051 5574 raft_consensus.cc:504] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:23.068663 5574 leader_election.cc:288] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a048a1876fe4765b6be9bcc11a2a433 (127.19.155.195:44205), 86ceb39f5da0463792c73ce5364dce8f (127.19.155.194:45521)
I20260811 18:55:23.077881 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.069066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:50695 (local address 127.19.155.195:44205)
0811 18:55:23.069271 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.069278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.070055 (+ 777us) server_negotiation.cc:407] Connection header received
0811 18:55:23.070283 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.070289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.070361 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.070461 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:23.071326 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.072487 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.075518 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.076707 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.076860 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.076919 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.077485 (+ 566us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.077615 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:55:23.077888 5557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.069140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:60795 (local address 127.19.155.194:45521)
0811 18:55:23.069339 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.069345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.070055 (+ 710us) server_negotiation.cc:407] Connection header received
0811 18:55:23.070270 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.070275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.070361 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.070461 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:23.071326 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.072487 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.075518 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.076693 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.076847 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.076919 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.077485 (+ 566us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.077615 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:55:23.078162 5576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.068913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45521 (local address 127.19.155.193:60795)
0811 18:55:23.069916 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:23.069936 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:23.070094 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:23.070496 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:23.070501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:23.070548 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:23.071171 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:23.071180 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.072648 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.072654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:23.075348 (+ 2694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:23.075365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.076976 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.076983 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:23.077184 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.077324 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 18:55:23.077423 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:55:23.077597 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"mutex_wait_us":255,"spinlock_wait_cycles":6400,"thread_start_us":596,"threads_started":1}
I20260811 18:55:23.078239 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.068918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:44205 (local address 127.19.155.193:50695)
0811 18:55:23.069915 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:23.069936 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:23.070152 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:23.070496 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:23.070501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:23.070543 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:23.071158 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:23.071174 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.072648 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.072654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:23.075348 (+ 2694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:23.075365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.076982 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.076987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:23.077187 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.077323 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 18:55:23.077423 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:55:23.077597 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":315,"spinlock_wait_cycles":38272,"thread_start_us":461,"threads_started":1}
I20260811 18:55:23.079456 5242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76c054eb87e443469ff5e0b6f8d676ee" candidate_uuid: "9dd0bbac9a4942c398f626ec566635ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ceb39f5da0463792c73ce5364dce8f" is_pre_election: true
I20260811 18:55:23.079456 5450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76c054eb87e443469ff5e0b6f8d676ee" candidate_uuid: "9dd0bbac9a4942c398f626ec566635ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a048a1876fe4765b6be9bcc11a2a433" is_pre_election: true
I20260811 18:55:23.080032 5242 raft_consensus.cc:2454] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd0bbac9a4942c398f626ec566635ff in term 0.
I20260811 18:55:23.080032 5450 raft_consensus.cc:2454] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dd0bbac9a4942c398f626ec566635ff in term 0.
I20260811 18:55:23.080719 4924 leader_election.cc:302] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a048a1876fe4765b6be9bcc11a2a433, 9dd0bbac9a4942c398f626ec566635ff; no voters:
I20260811 18:55:23.081068 5574 raft_consensus.cc:2781] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:23.081264 5574 raft_consensus.cc:482] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:23.081398 5574 raft_consensus.cc:3037] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:23.083665 5574 raft_consensus.cc:504] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:23.084390 5574 leader_election.cc:288] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [CANDIDATE]: Term 1 election: Requested vote from peers 2a048a1876fe4765b6be9bcc11a2a433 (127.19.155.195:44205), 86ceb39f5da0463792c73ce5364dce8f (127.19.155.194:45521)
I20260811 18:55:23.084748 5450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76c054eb87e443469ff5e0b6f8d676ee" candidate_uuid: "9dd0bbac9a4942c398f626ec566635ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a048a1876fe4765b6be9bcc11a2a433"
I20260811 18:55:23.084829 5242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76c054eb87e443469ff5e0b6f8d676ee" candidate_uuid: "9dd0bbac9a4942c398f626ec566635ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86ceb39f5da0463792c73ce5364dce8f"
I20260811 18:55:23.084947 5450 raft_consensus.cc:3037] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:23.085062 5242 raft_consensus.cc:3037] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 0 FOLLOWER]: Advancing to term 1
W20260811 18:55:23.085199 5302 tablet.cc:2369] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:23.087927 5450 raft_consensus.cc:2454] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd0bbac9a4942c398f626ec566635ff in term 1.
I20260811 18:55:23.088073 5242 raft_consensus.cc:2454] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dd0bbac9a4942c398f626ec566635ff in term 1.
I20260811 18:55:23.088333 4924 leader_election.cc:302] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a048a1876fe4765b6be9bcc11a2a433, 9dd0bbac9a4942c398f626ec566635ff; no voters:
I20260811 18:55:23.088616 5574 raft_consensus.cc:2781] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:23.089067 5574 raft_consensus.cc:686] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 1 LEADER]: Becoming Leader. State: Replica: 9dd0bbac9a4942c398f626ec566635ff, State: Running, Role: LEADER
I20260811 18:55:23.089525 5574 consensus_queue.cc:237] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } }
I20260811 18:55:23.094133 4800 catalog_manager.cc:5495] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 9dd0bbac9a4942c398f626ec566635ff (127.19.155.193). New cstate: current_term: 1 leader_uuid: "9dd0bbac9a4942c398f626ec566635ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9dd0bbac9a4942c398f626ec566635ff" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 } health_report { overall_health: UNKNOWN } } }
W20260811 18:55:23.118396 5531 tablet.cc:2369] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:23.136726 5554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.131018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36354 (local address 127.19.155.193:40727)
0811 18:55:23.131256 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.131262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.131282 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:55:23.131533 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.131537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.131614 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.131775 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:23.132616 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.133312 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.134658 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.135207 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.135333 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.135763 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:23.136257 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:23.136365 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.136470 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.136536 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:55:23.144791 5450 raft_consensus.cc:1261] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 1 FOLLOWER]: Refusing update from remote peer 9dd0bbac9a4942c398f626ec566635ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:23.144814 5242 raft_consensus.cc:1261] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 1 FOLLOWER]: Refusing update from remote peer 9dd0bbac9a4942c398f626ec566635ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:23.145773 5579 consensus_queue.cc:1035] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a048a1876fe4765b6be9bcc11a2a433" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:23.146112 5574 consensus_queue.cc:1035] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ceb39f5da0463792c73ce5364dce8f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:23.157492 5586 mvcc.cc:205] Tried to move back new op lower bound from 7317399646791106560 to 7317399646578315264. Current Snapshot: MvccSnapshot[applied={T|T < 7317399646791106560}]
I20260811 18:55:23.174201 4799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:23.174533 4799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49902:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:23.178607 4799 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0fe84987243404ea51715399dca8262: Sending DeleteTablet for 3 replicas of tablet 76c054eb87e443469ff5e0b6f8d676ee
I20260811 18:55:23.179754 5001 tablet_service.cc:1514] Processing DeleteTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:23 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:36340
I20260811 18:55:23.179971 5421 tablet_service.cc:1514] Processing DeleteTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:23 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:44554
I20260811 18:55:23.180080 5209 tablet_service.cc:1514] Processing DeleteTablet for tablet 76c054eb87e443469ff5e0b6f8d676ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:23 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46724
I20260811 18:55:23.181867 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 4902
I20260811 18:55:23.192493 5600 tablet_replica.cc:330] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: stopping tablet replica
I20260811 18:55:23.193202 5600 raft_consensus.cc:2229] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:23.193914 5600 raft_consensus.cc:2258] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:23.195901 5599 tablet_replica.cc:330] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: stopping tablet replica
I20260811 18:55:23.196326 5599 raft_consensus.cc:2229] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:55:23.196853 5600 ts_tablet_manager.cc:1905] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:23.197106 5599 raft_consensus.cc:2258] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:23.199410 5599 ts_tablet_manager.cc:1905] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:23.199770 5601 tablet_replica.cc:330] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: stopping tablet replica
I20260811 18:55:23.200210 5601 raft_consensus.cc:2229] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:23.200765 5601 raft_consensus.cc:2258] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:23.204576 5601 ts_tablet_manager.cc:1905] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:55:23.206916 5599 ts_tablet_manager.cc:1918] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:23.207080 5599 log.cc:1196] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/76c054eb87e443469ff5e0b6f8d676ee
I20260811 18:55:23.207633 5599 ts_tablet_manager.cc:1939] T 76c054eb87e443469ff5e0b6f8d676ee P 9dd0bbac9a4942c398f626ec566635ff: Deleting consensus metadata
I20260811 18:55:23.209446 4773 catalog_manager.cc:4841] TS 9dd0bbac9a4942c398f626ec566635ff (127.19.155.193:40727): tablet 76c054eb87e443469ff5e0b6f8d676ee (table test-table [id=274e352496884cbdaeda77d77926a1fc]) successfully deleted
I20260811 18:55:23.215178 5601 ts_tablet_manager.cc:1918] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:23.215291 5554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.183527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.19.155.193:40727)
0811 18:55:23.183746 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.183755 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.195206 (+ 11451us) server_negotiation.cc:407] Connection header received
0811 18:55:23.195446 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.195452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.195540 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.195663 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:23.197415 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.198601 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.200447 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.201232 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.201329 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.206864 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:23.206879 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:23.206931 (+ 52us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:23.206981 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:23.211687 (+ 4706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.212648 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.212656 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.212660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.212838 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.213306 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.213311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.213315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.213766 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:23.214055 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.214634 (+ 579us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.214879 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:55:23.216722 5087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:23.217103 5601 log.cc:1196] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/76c054eb87e443469ff5e0b6f8d676ee
I20260811 18:55:23.217097 5600 ts_tablet_manager.cc:1918] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:23.217506 5600 log.cc:1196] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/76c054eb87e443469ff5e0b6f8d676ee
I20260811 18:55:23.217664 5601 ts_tablet_manager.cc:1939] T 76c054eb87e443469ff5e0b6f8d676ee P 86ceb39f5da0463792c73ce5364dce8f: Deleting consensus metadata
I20260811 18:55:23.218883 5600 ts_tablet_manager.cc:1939] T 76c054eb87e443469ff5e0b6f8d676ee P 2a048a1876fe4765b6be9bcc11a2a433: Deleting consensus metadata
I20260811 18:55:23.220610 4776 catalog_manager.cc:4841] TS 86ceb39f5da0463792c73ce5364dce8f (127.19.155.194:45521): tablet 76c054eb87e443469ff5e0b6f8d676ee (table test-table [id=274e352496884cbdaeda77d77926a1fc]) successfully deleted
I20260811 18:55:23.221084 4773 catalog_manager.cc:4841] TS 2a048a1876fe4765b6be9bcc11a2a433 (127.19.155.195:44205): tablet 76c054eb87e443469ff5e0b6f8d676ee (table test-table [id=274e352496884cbdaeda77d77926a1fc]) successfully deleted
I20260811 18:55:23.319475 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 4902
I20260811 18:55:23.350881 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 5107
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:55:23.366125 5557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.351735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46726 (local address 127.19.155.194:45521)
0811 18:55:23.351931 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.351937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.351958 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:55:23.352117 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.352121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.352195 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.352303 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:23.353597 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.354363 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.355813 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.356200 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.356347 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.360268 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:23.360279 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:23.360293 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:23.360330 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:23.363309 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.363972 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.363979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.363982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.364106 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.364490 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.364495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.364498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.364927 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:23.365239 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.365559 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.365768 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:55:23.366866 5295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:23.454094 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 5107
I20260811 18:55:23.478562 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 5317
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[4726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:55:23.493076 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.479452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.19.155.195:44205)
0811 18:55:23.479650 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.479654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.479673 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:55:23.479819 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.479823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.479888 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.479982 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:23.481225 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.481958 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.483266 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.483653 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.483749 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.487740 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:23.487757 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:23.487775 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:23.487806 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:23.490589 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.491188 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.491195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.491197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.491327 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.491686 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.491689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.491691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.492054 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:23.492298 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.492568 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.492771 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:55:23.493736 5520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:23.581059 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 5317
I20260811 18:55:23.606971 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 4748
I20260811 18:55:23.608140 4852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:55:23.713488 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 4748
2026-08-11T18:55:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4540 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[5616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[5616](info): set up 2 sockets
Aug 11 18:55:23 dist-test-slave-1nl6 krb5kdc[5616](info): commencing operation
krb5kdc: starting...
W20260811 18:55:25.126519 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.360s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:55:25 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangeradmin_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangeradmin_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangerlookup_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangerlookup_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
I20260811 18:55:25.521808 20079 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVECISF/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/postgres -l logfile start
2026-08-11 18:55:27.868 UTC [5664] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:55:27.868 UTC [5664] LOG: listening on IPv4 address "127.19.155.212", port 53981
2026-08-11 18:55:27.872 UTC [5664] LOG: listening on Unix socket "/tmp/.s.PGSQL.53981"
2026-08-11 18:55:27.895 UTC [5669] LOG: database system was shut down at 2026-08-11 18:55:26 UTC
2026-08-11 18:55:27.899 UTC [5664] LOG: database system is ready to accept connections
I20260811 18:55:29.090180 20079 mini_postgres.cc:96] Postgres bound to 53981
2026-08-11 18:55:29.114 UTC [5691] FATAL: database "slave" does not exist
127.19.155.212:53981 - accepting connections
I20260811 18:55:29.115826 20079 mini_ranger.cc:161] Starting Ranger...
I20260811 18:55:29.144982 20079 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:55:29.565837 20079 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:55:29.565990 20079 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin
2026-08-11 18:55:29,848 [I] DB FLAVOR :POSTGRES
2026-08-11 18:55:29,848 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:55:29,849 [I] Checking connection..
2026-08-11 18:55:29,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:55:30,090 [I] Checking connection passed.
2026-08-11 18:55:30,090 [I] --------- Verifying version history table ---------
2026-08-11 18:55:30,090 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:55:30,341 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:55:30,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:55:30,592 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:55:30,592 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:55:30,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:55:30.831 UTC [5796] WARNING: there is no transaction in progress
2026-08-11 18:55:30,839 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:55:30,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:55:31,092 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:55:31,092 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:55:31,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:55:31,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:55:31,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1nl6.c.gcp-upstream.internal','N') ;"
2026-08-11 18:55:31,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:55:32,075 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:55:32,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:55:32,334 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:55:32,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:55:32,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:55:32,856 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:55:32,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:55:33.744 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.760 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.775 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.788 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.802 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.820 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.869 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.875 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.888 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.897 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.906 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.918 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.926 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.933 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.939 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:33.945 UTC [5968] WARNING: there is no transaction in progress
2026-08-11 18:55:34,515 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:55:34,516 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:55:34,767 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:55:34,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:55:35,007 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:55:35,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:55:35,263 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:55:35,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:55:35,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:55:35,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1nl6.c.gcp-upstream.internal';"
2026-08-11 18:55:36,013 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:55:36,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:55:36,267 [I] DB_PATCHES have already been applied
I20260811 18:55:36.273214 20079 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVECISF/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:55:36.273306 20079 mini_ranger.cc:193] Using host: 127.19.155.212
I20260811 18:55:36.295607 20079 mini_ranger.cc:227] Ranger admin URL: http://127.19.155.212:58287
Aug 11, 2026 6:55:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:55:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:55:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:55:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:55:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:55:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:55:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:55:37.700275 20079 mini_ranger.cc:160] Time spent starting Ranger: real 8.584s user 0.004s sys 0.059s
Aug 11, 2026 6:55:58 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:55:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 11, 2026 6:55:58 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:55:58 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:55:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:55:59.538256 20079 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangerkms_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/rangerkms_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.155.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.155.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:55:59 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474559, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:55:59.746121 20079 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:55:59.771863 20079 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:56:00.560874 20079 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:56:00.561057 20079 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms
I20260811 18:56:00.561208 20079 mini_ranger_kms.cc:227] Using postgres at 127.19.155.212:53981
2026-08-11 18:56:01,050 [I] DB FLAVOR :POSTGRES
2026-08-11 18:56:01,051 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:56:01,051 [I] Checking connection
2026-08-11 18:56:01,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:56:01,345 [I] connection success
2026-08-11 18:56:01,346 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:56:01,346 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:56:01,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:56:01,633 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:56:01,633 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:56:01,634 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:56:01,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:53981/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:56:01,938 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:56:02.404737 20079 mini_ranger_kms.cc:310] Created kms service
I20260811 18:56:02.601110 20079 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:56:02.645205 20079 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:56:02 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474559, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:03.069433 20079 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:56:03.069793 20079 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:56:03.069864 20079 mini_ranger_kms.cc:240] Using host: 127.19.155.212
I20260811 18:56:03.102805 20079 mini_ranger_kms.cc:276] Ranger KMS PID: 6262
I20260811 18:56:03.103119 20079 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.155.212:58647
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:56:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:56:05 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474565, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:05.940231 20079 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.194s user 0.100s sys 0.431s
I20260811 18:56:05.940605 20079 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:56:05.940858 20079 mini_ranger_kms.cc:401] 127.19.155.212:58647/kms/v1/keys
Aug 11 18:56:06 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474565, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
Aug 11 18:56:06 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474565, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
Aug 11 18:56:08 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:56:08.810853 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35837
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:35837
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:58647/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:09.178390 6339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:09.178661 6339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:09.178817 6339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:09.186393 6339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:09.186502 6339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:09.186616 6339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:09.186713 6339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:09.186801 6339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:09.197239 6339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.155.212:58647/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:35837
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:56:09.198578 6339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:09.199977 6339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:09.212672 6349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:09.212821 6348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:09.212788 6353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:09.213088 6339 server_base.cc:1034] running on GCE node
I20260811 18:56:09.214138 6339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:09.215596 6339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:09.216800 6339 hybrid_clock.cc:648] HybridClock initialized: now 1786474569216744 us; error 39 us; skew 500 ppm
I20260811 18:56:09.217163 6339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:56:09 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474569, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:09.225136 6339 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:56:09.226604 6339 webserver.cc:460] Webserver started at http://127.19.155.254:40147/ using document root <none> and password file <none>
I20260811 18:56:09.227345 6339 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:09.227490 6339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:09.227818 6339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:56:09 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474569, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:09.279006 6339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "d3077569f0774b0888e7e156265806a0"
format_stamp: "Formatted at 2026-08-11 18:56:09 on dist-test-slave-1nl6"
server_key: "ce4f59bb73f8d9c7fdc1ef7d263e2e01"
server_key_iv: "27545993989d231d120bab231b440afe"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:09.279866 6339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "d3077569f0774b0888e7e156265806a0"
format_stamp: "Formatted at 2026-08-11 18:56:09 on dist-test-slave-1nl6"
server_key: "ce4f59bb73f8d9c7fdc1ef7d263e2e01"
server_key_iv: "27545993989d231d120bab231b440afe"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:09.285545 6339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:56:09.306764 6364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:09.308717 6339 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 18:56:09.308913 6339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "d3077569f0774b0888e7e156265806a0"
format_stamp: "Formatted at 2026-08-11 18:56:09 on dist-test-slave-1nl6"
server_key: "ce4f59bb73f8d9c7fdc1ef7d263e2e01"
server_key_iv: "27545993989d231d120bab231b440afe"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:09.309195 6339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:09.337970 6339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:09.343065 6339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:09.343391 6339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:09.365758 6339 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:35837
I20260811 18:56:09.365808 6447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:35837 every 8 connection(s)
I20260811 18:56:09.367271 6339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:09.371140 6448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:09.377611 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 6339
I20260811 18:56:09.377830 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:56:09.378705 20079 external_mini_cluster.cc:1428] Setting key e465739159d2f3edd7ebc5570c14042b
I20260811 18:56:09.382503 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: Bootstrap starting.
I20260811 18:56:09.386214 6448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:09.387420 6448 log.cc:824] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:09.390483 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: No bootstrap required, opened a new log
Aug 11 18:56:09 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:56:09.398670 6448 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } }
I20260811 18:56:09.399114 6448 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:09.399253 6448 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3077569f0774b0888e7e156265806a0, State: Initialized, Role: FOLLOWER
I20260811 18:56:09.399808 6448 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } }
I20260811 18:56:09.400058 6448 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:09.400209 6448 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:09.400408 6448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:09.401876 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:09.380982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47888 (local address 127.19.155.254:35837)
0811 18:56:09.381900 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:09.381912 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:09.381954 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:56:09.383782 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:09.383805 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:09.384173 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:09.384498 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:09.386147 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:09.387664 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:09.389196 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:09.389844 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:09.389974 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:09.394521 (+ 4547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:09.394531 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:09.394549 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:09.394583 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:09.397839 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:09.398500 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:09.398512 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:09.398519 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:09.398651 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:09.399106 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:09.399111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:09.399116 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:09.399784 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:09.400111 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:09.400508 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 18:56:09.400906 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":454,"threads_started":1}
I20260811 18:56:09.402825 6448 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } }
I20260811 18:56:09.403434 6448 leader_election.cc:302] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3077569f0774b0888e7e156265806a0; no voters:
I20260811 18:56:09.404095 6448 leader_election.cc:288] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:09.404208 6458 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:09.405331 6458 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [term 1 LEADER]: Becoming Leader. State: Replica: d3077569f0774b0888e7e156265806a0, State: Running, Role: LEADER
I20260811 18:56:09.405965 6458 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } }
I20260811 18:56:09.406242 6448 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:09.409355 6460 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3077569f0774b0888e7e156265806a0. Latest consensus state: current_term: 1 leader_uuid: "d3077569f0774b0888e7e156265806a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } } }
I20260811 18:56:09.409765 6460 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:09.410290 6459 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3077569f0774b0888e7e156265806a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3077569f0774b0888e7e156265806a0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35837 } } }
I20260811 18:56:09.410665 6459 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:09.414794 6471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:09.422180 6471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:09.426126 6448 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:56:09.443890 6471 catalog_manager.cc:1347] Generated new cluster ID: 51797bed8e564d0d91df0d1ac8149e85
I20260811 18:56:09.444128 6471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:09.477319 6471 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:09.478734 6471 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:09.494073 6471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: Generated new TSK 0
I20260811 18:56:09.494995 6471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:56:10.311609 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:58647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:56:10 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:56:10.870349 6526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:10.870627 6526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:10.870796 6526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:10.878181 6526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:10.878305 6526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:10.878502 6526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:56:10.893224 6526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.155.212:58647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:56:10.895151 6526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:10.896971 6526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:10.923494 6539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:10.926576 6542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:10.927261 6526 server_base.cc:1034] running on GCE node
W20260811 18:56:10.928121 6544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:10.928997 6526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:10.931342 6526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:10.932653 6526 hybrid_clock.cc:648] HybridClock initialized: now 1786474570932544 us; error 93 us; skew 500 ppm
I20260811 18:56:10.933109 6526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:56:10 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:10.937709 6526 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:56:10.950350 6526 webserver.cc:460] Webserver started at http://127.19.155.193:41799/ using document root <none> and password file <none>
I20260811 18:56:10.951386 6526 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:10.951555 6526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:10.951977 6526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:56:10 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:10.973537 6526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "7af13bcdfdf348ae98583f71ca77f633"
format_stamp: "Formatted at 2026-08-11 18:56:10 on dist-test-slave-1nl6"
server_key: "78726517f907384b5a8f83993cdf492f"
server_key_iv: "5fdf878ee328b0f69504977c718c2f40"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:10.974767 6526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "7af13bcdfdf348ae98583f71ca77f633"
format_stamp: "Formatted at 2026-08-11 18:56:10 on dist-test-slave-1nl6"
server_key: "78726517f907384b5a8f83993cdf492f"
server_key_iv: "5fdf878ee328b0f69504977c718c2f40"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:10.996003 6526 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.004s sys 0.012s
I20260811 18:56:11.027596 6551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:11.029635 6526 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.008s sys 0.003s
I20260811 18:56:11.029903 6526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "7af13bcdfdf348ae98583f71ca77f633"
format_stamp: "Formatted at 2026-08-11 18:56:10 on dist-test-slave-1nl6"
server_key: "78726517f907384b5a8f83993cdf492f"
server_key_iv: "5fdf878ee328b0f69504977c718c2f40"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:11.030259 6526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 18:56:11 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:11.094157 6526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:11.100101 6526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:11.100526 6526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:11.107065 6526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:11.116658 6526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:11.116828 6526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:11.117033 6526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:11.117156 6526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:11.263535 6526 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40897
I20260811 18:56:11.263556 6720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40897 every 8 connection(s)
I20260811 18:56:11.265223 6526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:11.270921 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 6526
I20260811 18:56:11.271126 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:56:11.271975 20079 external_mini_cluster.cc:1428] Setting key 52584f3dd32d126170a5a9b316f56305
Aug 11 18:56:11 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:56:11.321311 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:11.270949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:39553 (local address 127.19.155.254:35837)
0811 18:56:11.290847 (+ 19898us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:11.290858 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:11.294956 (+ 4098us) server_negotiation.cc:407] Connection header received
0811 18:56:11.297803 (+ 2847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:11.297809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:11.297907 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:11.298040 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:11.300628 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:11.302048 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:11.305274 (+ 3226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:11.306175 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:11.306311 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:11.311936 (+ 5625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:11.311948 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:11.311956 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:11.312005 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:11.316553 (+ 4548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:11.317708 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:11.317718 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:11.317724 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:11.317917 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:11.318631 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:11.318639 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:11.318659 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:11.319146 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:11.319308 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:11.320488 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0811 18:56:11.320786 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19678,"thread_start_us":19916,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:56:11.323869 6724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:11.269944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35837 (local address 127.19.155.193:39553)
0811 18:56:11.291864 (+ 21920us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:11.291953 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:11.297492 (+ 5539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:11.298568 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:11.298583 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:11.299401 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:11.300386 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:11.300417 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:11.302292 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:11.302301 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:11.305081 (+ 2780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:11.305102 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:11.306741 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:11.306752 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:11.307191 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:11.308151 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:11.308188 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:11.311523 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:11.316761 (+ 5238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:11.316775 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:11.316798 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:11.317522 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:11.318109 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:11.318119 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:11.318124 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:11.318463 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:11.319427 (+ 964us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:11.319438 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:11.319959 (+ 521us) client_negotiation.cc:769] Sending connection context
0811 18:56:11.321725 (+ 1766us) client_negotiation.cc:240] Negotiation successful
0811 18:56:11.322355 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21424,"thread_start_us":24810,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
I20260811 18:56:11.330215 6721 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35837
I20260811 18:56:11.330595 6721 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:11.331668 6721 heartbeater.cc:511] Master 127.19.155.254:35837 requested a full tablet report, sending...
I20260811 18:56:11.334795 6390 ts_manager.cc:194] Registered new tserver with Master: 7af13bcdfdf348ae98583f71ca77f633 (127.19.155.193:40897)
I20260811 18:56:11.337252 6390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:39553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:56:11.370126 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:58647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:56:11 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
W20260811 18:56:11.868721 6731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:11.869138 6731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:11.869349 6731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:11.880883 6731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:11.881065 6731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:11.881296 6731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:56:11.896934 6731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.155.212:58647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:56:11.898772 6731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:11.900456 6731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:11.917207 6758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:11.923386 6759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:11.926205 6763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:11.927063 6731 server_base.cc:1034] running on GCE node
I20260811 18:56:11.927910 6731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:11.929247 6731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:11.930586 6731 hybrid_clock.cc:648] HybridClock initialized: now 1786474571930476 us; error 88 us; skew 500 ppm
I20260811 18:56:11.931030 6731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:56:11 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474571, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:11.935616 6731 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:56:11.937973 6731 webserver.cc:460] Webserver started at http://127.19.155.194:43155/ using document root <none> and password file <none>
I20260811 18:56:11.938865 6731 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:11.939072 6731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:11.939455 6731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:56:11 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474571, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:11.959950 6731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "08a8ab7fe40d4cda84c2067ee12d6c09"
format_stamp: "Formatted at 2026-08-11 18:56:11 on dist-test-slave-1nl6"
server_key: "092621b880f583e274361c9fd646bc70"
server_key_iv: "a15d8ad6b70c85ce47989423db61db1c"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:11.961009 6731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "08a8ab7fe40d4cda84c2067ee12d6c09"
format_stamp: "Formatted at 2026-08-11 18:56:11 on dist-test-slave-1nl6"
server_key: "092621b880f583e274361c9fd646bc70"
server_key_iv: "a15d8ad6b70c85ce47989423db61db1c"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:11.976083 6731 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.013s sys 0.000s
I20260811 18:56:12.015130 6775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.017460 6731 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.003s sys 0.010s
I20260811 18:56:12.017767 6731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "08a8ab7fe40d4cda84c2067ee12d6c09"
format_stamp: "Formatted at 2026-08-11 18:56:11 on dist-test-slave-1nl6"
server_key: "092621b880f583e274361c9fd646bc70"
server_key_iv: "a15d8ad6b70c85ce47989423db61db1c"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:12.018147 6731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:12.051295 6731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:12.057060 6731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:12.057408 6731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:12.058621 6731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:12.060444 6731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:12.060549 6731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.060740 6731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:12.060818 6731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.106812 6731 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:33787
I20260811 18:56:12.106825 6958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:33787 every 8 connection(s)
I20260811 18:56:12.108669 6731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:56:12.109484 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 6731
I20260811 18:56:12.109673 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:56:12.110296 20079 external_mini_cluster.cc:1428] Setting key 230c0b92aadfa9c85e1c36b5fc6c965a
Aug 11 18:56:12 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474571, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:56:12.155100 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.119350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:44143 (local address 127.19.155.254:35837)
0811 18:56:12.129334 (+ 9984us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.129341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.130986 (+ 1645us) server_negotiation.cc:407] Connection header received
0811 18:56:12.133173 (+ 2187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.133179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.133282 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.133407 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:12.135333 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.136501 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.139943 (+ 3442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.140861 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.142179 (+ 1318us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.145805 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:12.145815 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:12.145823 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:12.145877 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:12.151059 (+ 5182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.152010 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.152018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.152024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.152200 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.152787 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.152801 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.152807 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.153228 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:12.153420 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.154281 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.154537 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9843,"thread_start_us":9723,"threads_started":1}
I20260811 18:56:12.156070 6963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.118755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35837 (local address 127.19.155.194:44143)
0811 18:56:12.129997 (+ 11242us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.130059 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.132876 (+ 2817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.133636 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.133649 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.134310 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:12.135159 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.135185 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.136730 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.136735 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.138675 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.138701 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.141226 (+ 2525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.141237 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.141661 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.142542 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:12.142573 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:12.145520 (+ 2947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:12.151204 (+ 5684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:12.151214 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:12.151234 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:12.151847 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:12.152325 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:12.152330 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:12.152334 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:12.152635 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:12.153361 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:12.153369 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:12.153830 (+ 461us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.154132 (+ 302us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.154679 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10914,"thread_start_us":10636,"threads_started":1}
I20260811 18:56:12.158494 6960 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35837
I20260811 18:56:12.158948 6960 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:12.159953 6960 heartbeater.cc:511] Master 127.19.155.254:35837 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
I20260811 18:56:12.161815 6390 ts_manager.cc:194] Registered new tserver with Master: 08a8ab7fe40d4cda84c2067ee12d6c09 (127.19.155.194:33787)
I20260811 18:56:12.162989 6390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:44143
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:56:12.197844 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:58647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:56:12.341648 6721 heartbeater.cc:503] Master 127.19.155.254:35837 was elected leader, sending a full tablet report...
W20260811 18:56:12.559466 6971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:12.559721 6971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:12.559928 6971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:12.567063 6971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:12.567183 6971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:12.567368 6971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:56:12.577122 6971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.155.212:58647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:35837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:56:12.578464 6971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:12.579896 6971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:12.593274 6985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:12.593405 6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:12.593473 6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:12.594362 6971 server_base.cc:1034] running on GCE node
I20260811 18:56:12.595005 6971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:12.595947 6971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:12.597177 6971 hybrid_clock.cc:648] HybridClock initialized: now 1786474572597131 us; error 53 us; skew 500 ppm
I20260811 18:56:12.597517 6971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:56:12 dist-test-slave-1nl6 krb5kdc[5616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474572, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:12.600857 6971 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:56:12.602546 6971 webserver.cc:460] Webserver started at http://127.19.155.195:43757/ using document root <none> and password file <none>
I20260811 18:56:12.603243 6971 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:12.603359 6971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:12.603623 6971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:56:12 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474572, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:12.617309 6971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "abfa17cfca5647b5843ce44c78364886"
format_stamp: "Formatted at 2026-08-11 18:56:12 on dist-test-slave-1nl6"
server_key: "72dd5d103d539103261b7e33e54f618d"
server_key_iv: "539200f51bd10608a2c3e0c1a1f2fedf"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:12.618398 6971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "abfa17cfca5647b5843ce44c78364886"
format_stamp: "Formatted at 2026-08-11 18:56:12 on dist-test-slave-1nl6"
server_key: "72dd5d103d539103261b7e33e54f618d"
server_key_iv: "539200f51bd10608a2c3e0c1a1f2fedf"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:12.624450 6971 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 18:56:12.637984 7000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.639398 6971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:56:12.639539 6971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "abfa17cfca5647b5843ce44c78364886"
format_stamp: "Formatted at 2026-08-11 18:56:12 on dist-test-slave-1nl6"
server_key: "72dd5d103d539103261b7e33e54f618d"
server_key_iv: "539200f51bd10608a2c3e0c1a1f2fedf"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:12.639720 6971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:12.658438 6971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:12.662544 6971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:12.662866 6971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:12.663846 6971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:12.665220 6971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:12.665294 6971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.665488 6971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:12.665544 6971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:12.700357 6971 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:45325
I20260811 18:56:12.700402 7183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:45325 every 8 connection(s)
I20260811 18:56:12.701736 6971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:12.707614 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 6971
I20260811 18:56:12.707835 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:56:12.708307 20079 external_mini_cluster.cc:1428] Setting key 58f7773a1779bb290c315419cf654ba7
Aug 11 18:56:12 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474572, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:56:12.722679 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.704348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:33221 (local address 127.19.155.254:35837)
0811 18:56:12.704935 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.704944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.705885 (+ 941us) server_negotiation.cc:407] Connection header received
0811 18:56:12.707827 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.707833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.707933 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.708059 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:12.709934 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.711121 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.712929 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.713353 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.713452 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.716883 (+ 3431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:12.716888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:12.716891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:12.716922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:12.719733 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.720387 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.720391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.720393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.720515 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.720900 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.720903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.720905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.721159 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:12.721269 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.722014 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.722191 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":254,"threads_started":1}
I20260811 18:56:12.723968 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.705005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:35837 (local address 127.19.155.195:33221)
0811 18:56:12.705723 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.705764 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.707539 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.708309 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.708317 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.708839 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:12.709740 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.709771 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.711299 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.711308 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.712769 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.712801 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.713549 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.713554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.713756 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.714419 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:12.714441 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:12.716688 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:12.719847 (+ 3159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:12.719854 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:12.719865 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:12.720289 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:12.720620 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:12.720623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:12.720625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:12.720800 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:12.721302 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:12.721309 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:12.721632 (+ 323us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.721882 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.722412 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":292,"threads_started":1}
I20260811 18:56:12.725287 7186 heartbeater.cc:347] Connected to a master server at 127.19.155.254:35837
I20260811 18:56:12.725601 7186 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:12.726313 7186 heartbeater.cc:511] Master 127.19.155.254:35837 requested a full tablet report, sending...
I20260811 18:56:12.727864 6390 ts_manager.cc:194] Registered new tserver with Master: abfa17cfca5647b5843ce44c78364886 (127.19.155.195:45325)
I20260811 18:56:12.728672 6390 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:33221
I20260811 18:56:12.736702 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:12.754376 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.741317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47898 (local address 127.19.155.254:35837)
0811 18:56:12.741511 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.741519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.741962 (+ 443us) server_negotiation.cc:407] Connection header received
0811 18:56:12.742176 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.742181 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.742259 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.742366 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:12.743953 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.744742 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.746140 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.746590 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.746755 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.749160 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:12.749166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:12.749169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:12.749197 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:12.751673 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.752439 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.752445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.752449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.752570 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:12.752959 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:12.752964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:12.752967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:12.753235 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:12.753503 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.753835 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.754054 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:56:12.758285 6390 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:12.765744 6390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:12.791000 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.779711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41450 (local address 127.19.155.194:33787)
0811 18:56:12.781660 (+ 1949us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.781669 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.782163 (+ 494us) server_negotiation.cc:407] Connection header received
0811 18:56:12.783153 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.783161 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.783365 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.783574 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:12.784499 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786010 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.788531 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.789758 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.789956 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.790126 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.790401 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.790582 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1791,"thread_start_us":1675,"threads_started":1}
I20260811 18:56:12.791045 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.779430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33787 (local address 127.0.0.1:41450)
0811 18:56:12.782053 (+ 2623us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.782067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.782846 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.783567 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.783571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.783592 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:12.784278 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.784294 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786151 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.786156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.788276 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.788288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.789969 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.789975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.790159 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.790206 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.790336 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.790558 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2520,"mutex_wait_us":79,"thread_start_us":3087,"threads_started":1}
I20260811 18:56:12.792100 7201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.778702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40897 (local address 127.0.0.1:38330)
0811 18:56:12.782011 (+ 3309us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.782052 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.782328 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.783503 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.783511 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.783546 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:12.784041 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.784052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786220 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.786225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.788940 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.788956 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.791237 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.791244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.791429 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.791469 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.791561 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.791682 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3036,"mutex_wait_us":162,"thread_start_us":589,"threads_started":1}
I20260811 18:56:12.792301 7202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.779821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:45325 (local address 127.0.0.1:43176)
0811 18:56:12.782790 (+ 2969us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.782807 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.782964 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.784288 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.784295 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.784326 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:12.784727 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.784741 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786648 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.786653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.788945 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.788956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.791465 (+ 2509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.791470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.791658 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.791687 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.791769 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.791894 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2836,"mutex_wait_us":5,"thread_start_us":2000,"threads_started":1}
I20260811 18:56:12.793171 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.779401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43176 (local address 127.19.155.195:45325)
0811 18:56:12.781200 (+ 1799us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.781211 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.782940 (+ 1729us) server_negotiation.cc:407] Connection header received
0811 18:56:12.783767 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.783777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.783991 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.784207 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:12.784935 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786429 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.789129 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.790594 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.790792 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.790976 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.792643 (+ 1667us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.792820 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1595,"thread_start_us":1420,"threads_started":1}
I20260811 18:56:12.792212 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.778891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38330 (local address 127.19.155.193:40897)
0811 18:56:12.780599 (+ 1708us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.780611 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.782161 (+ 1550us) server_negotiation.cc:407] Connection header received
0811 18:56:12.782633 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.782643 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.782890 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.783164 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:12.784224 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.786036 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.789142 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.790626 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.790802 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.790976 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.791657 (+ 681us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.791814 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1379,"thread_start_us":1184,"threads_started":1}
I20260811 18:56:12.795274 6855 tablet_service.cc:1467] Processing CreateTablet for tablet 388ba28c157c4eed846b732398a1315a (DEFAULT_TABLE table=test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:12.796448 6855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 388ba28c157c4eed846b732398a1315a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:12.796821 6623 tablet_service.cc:1467] Processing CreateTablet for tablet 388ba28c157c4eed846b732398a1315a (DEFAULT_TABLE table=test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:12.796823 7078 tablet_service.cc:1467] Processing CreateTablet for tablet 388ba28c157c4eed846b732398a1315a (DEFAULT_TABLE table=test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:12.798264 6623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 388ba28c157c4eed846b732398a1315a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:12.798267 7078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 388ba28c157c4eed846b732398a1315a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:12.808347 7209 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Bootstrap starting.
I20260811 18:56:12.811934 7209 tablet_bootstrap.cc:654] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:12.813051 7209 log.cc:824] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:12.813565 7212 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Bootstrap starting.
I20260811 18:56:12.815991 7213 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Bootstrap starting.
I20260811 18:56:12.817824 7212 tablet_bootstrap.cc:654] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:12.818056 7209 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: No bootstrap required, opened a new log
I20260811 18:56:12.818348 7209 ts_tablet_manager.cc:1397] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260811 18:56:12.819126 7212 log.cc:824] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:12.821848 7213 tablet_bootstrap.cc:654] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:12.823221 7213 log.cc:824] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:12.825035 7212 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: No bootstrap required, opened a new log
I20260811 18:56:12.825296 7212 ts_tablet_manager.cc:1397] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260811 18:56:12.826027 7213 tablet_bootstrap.cc:492] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: No bootstrap required, opened a new log
I20260811 18:56:12.826294 7213 ts_tablet_manager.cc:1397] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260811 18:56:12.829571 7209 raft_consensus.cc:348] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.830116 7209 raft_consensus.cc:374] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:12.830262 7209 raft_consensus.cc:729] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a8ab7fe40d4cda84c2067ee12d6c09, State: Initialized, Role: FOLLOWER
I20260811 18:56:12.830993 7209 consensus_queue.cc:260] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.832165 6960 heartbeater.cc:503] Master 127.19.155.254:35837 was elected leader, sending a full tablet report...
I20260811 18:56:12.832772 7209 ts_tablet_manager.cc:1428] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Time spent starting tablet: real 0.014s user 0.014s sys 0.002s
I20260811 18:56:12.834860 7213 raft_consensus.cc:348] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.835273 7213 raft_consensus.cc:374] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:12.835439 7213 raft_consensus.cc:729] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfa17cfca5647b5843ce44c78364886, State: Initialized, Role: FOLLOWER
I20260811 18:56:12.836081 7213 consensus_queue.cc:260] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.836088 7212 raft_consensus.cc:348] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.836500 7212 raft_consensus.cc:374] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:12.836633 7212 raft_consensus.cc:729] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af13bcdfdf348ae98583f71ca77f633, State: Initialized, Role: FOLLOWER
I20260811 18:56:12.837175 7212 consensus_queue.cc:260] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.838991 7186 heartbeater.cc:503] Master 127.19.155.254:35837 was elected leader, sending a full tablet report...
I20260811 18:56:12.839654 7213 ts_tablet_manager.cc:1428] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260811 18:56:12.839695 7212 ts_tablet_manager.cc:1428] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260811 18:56:12.886567 6962 tablet.cc:2369] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:56:12.953575 7187 tablet.cc:2369] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:12.968845 7223 raft_consensus.cc:482] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:12.969213 7223 raft_consensus.cc:504] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.971334 7223 leader_election.cc:288] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7af13bcdfdf348ae98583f71ca77f633 (127.19.155.193:40897), 08a8ab7fe40d4cda84c2067ee12d6c09 (127.19.155.194:33787)
I20260811 18:56:12.977924 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.971705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33787 (local address 127.19.155.195:45547)
0811 18:56:12.972064 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.972084 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.972245 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.972647 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.972653 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.972686 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:12.972904 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.972917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.974196 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.974200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.976165 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.976179 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.977401 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.977405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.977528 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.977553 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.977627 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.977723 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":18}
I20260811 18:56:12.978080 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.971845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:45547 (local address 127.19.155.194:33787)
0811 18:56:12.972168 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.972177 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.972206 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:56:12.972414 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.972420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.972501 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.972604 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:12.973056 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.974062 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.976309 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.977253 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.977408 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.977484 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.977679 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.977809 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 18:56:12.978986 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.971866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:50357 (local address 127.19.155.193:40897)
0811 18:56:12.972101 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:12.972110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:12.972745 (+ 635us) server_negotiation.cc:407] Connection header received
0811 18:56:12.972995 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:12.973003 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:12.973083 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:12.973180 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:12.973717 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.974594 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.976843 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.978070 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.978258 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.978348 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:12.978618 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 18:56:12.978750 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:56:12.979116 7225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:12.971758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40897 (local address 127.19.155.195:50357)
0811 18:56:12.972636 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:12.972652 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:12.972843 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:12.973213 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:12.973216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:12.973237 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:12.973537 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.973545 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.974880 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.974886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.976691 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:12.976704 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:12.978321 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:12.978327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:12.978461 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:12.978484 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:56:12.978559 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:56:12.978699 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":52,"spinlock_wait_cycles":22784,"thread_start_us":550,"threads_started":1}
I20260811 18:56:12.979235 6879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "388ba28c157c4eed846b732398a1315a" candidate_uuid: "abfa17cfca5647b5843ce44c78364886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" is_pre_election: true
I20260811 18:56:12.979754 6879 raft_consensus.cc:2454] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abfa17cfca5647b5843ce44c78364886 in term 0.
I20260811 18:56:12.980193 6656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "388ba28c157c4eed846b732398a1315a" candidate_uuid: "abfa17cfca5647b5843ce44c78364886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af13bcdfdf348ae98583f71ca77f633" is_pre_election: true
I20260811 18:56:12.980413 7002 leader_election.cc:302] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a8ab7fe40d4cda84c2067ee12d6c09, abfa17cfca5647b5843ce44c78364886; no voters:
I20260811 18:56:12.980759 6656 raft_consensus.cc:2454] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abfa17cfca5647b5843ce44c78364886 in term 0.
I20260811 18:56:12.980808 7223 raft_consensus.cc:2781] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:12.981029 7223 raft_consensus.cc:482] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:12.981166 7223 raft_consensus.cc:3037] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:12.983520 7223 raft_consensus.cc:504] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.984102 7223 leader_election.cc:288] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [CANDIDATE]: Term 1 election: Requested vote from peers 7af13bcdfdf348ae98583f71ca77f633 (127.19.155.193:40897), 08a8ab7fe40d4cda84c2067ee12d6c09 (127.19.155.194:33787)
I20260811 18:56:12.984625 6656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "388ba28c157c4eed846b732398a1315a" candidate_uuid: "abfa17cfca5647b5843ce44c78364886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7af13bcdfdf348ae98583f71ca77f633"
I20260811 18:56:12.984683 6879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "388ba28c157c4eed846b732398a1315a" candidate_uuid: "abfa17cfca5647b5843ce44c78364886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09"
I20260811 18:56:12.984854 6656 raft_consensus.cc:3037] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:12.984917 6879 raft_consensus.cc:3037] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:12.987106 6656 raft_consensus.cc:2454] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abfa17cfca5647b5843ce44c78364886 in term 1.
I20260811 18:56:12.987205 6879 raft_consensus.cc:2454] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abfa17cfca5647b5843ce44c78364886 in term 1.
I20260811 18:56:12.987579 7003 leader_election.cc:302] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7af13bcdfdf348ae98583f71ca77f633, abfa17cfca5647b5843ce44c78364886; no voters:
I20260811 18:56:12.987893 7223 raft_consensus.cc:2781] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:12.988338 7223 raft_consensus.cc:686] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 1 LEADER]: Becoming Leader. State: Replica: abfa17cfca5647b5843ce44c78364886, State: Running, Role: LEADER
I20260811 18:56:12.988803 7223 consensus_queue.cc:237] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } }
I20260811 18:56:12.993825 6389 catalog_manager.cc:5495] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 reported cstate change: term changed from 0 to 1, leader changed from <none> to abfa17cfca5647b5843ce44c78364886 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "abfa17cfca5647b5843ce44c78364886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfa17cfca5647b5843ce44c78364886" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 } health_report { overall_health: UNKNOWN } } }
I20260811 18:56:13.029515 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:13.023663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43188 (local address 127.19.155.195:45325)
0811 18:56:13.023897 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:13.023902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:13.024147 (+ 245us) server_negotiation.cc:407] Connection header received
0811 18:56:13.024368 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:13.024372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:13.024449 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:13.024713 (+ 264us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:13.025114 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.025826 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.027297 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.027714 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.027854 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:13.028421 (+ 567us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:13.028932 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:13.029108 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:13.029160 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 18:56:13.029244 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 18:56:13.038321 6879 raft_consensus.cc:1261] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 1 FOLLOWER]: Refusing update from remote peer abfa17cfca5647b5843ce44c78364886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:13.038319 6656 raft_consensus.cc:1261] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 1 FOLLOWER]: Refusing update from remote peer abfa17cfca5647b5843ce44c78364886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:13.039522 7227 consensus_queue.cc:1035] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7af13bcdfdf348ae98583f71ca77f633" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:13.039973 7223 consensus_queue.cc:1035] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a8ab7fe40d4cda84c2067ee12d6c09" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:56:13.049489 6722 tablet.cc:2369] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:13.053925 7234 mvcc.cc:205] Tried to move back new op lower bound from 7317399851153145856 to 7317399850965733376. Current Snapshot: MvccSnapshot[applied={T|T < 7317399851153145856}]
I20260811 18:56:13.055392 7233 mvcc.cc:205] Tried to move back new op lower bound from 7317399851153145856 to 7317399850965733376. Current Snapshot: MvccSnapshot[applied={T|T < 7317399851153145856}]
I20260811 18:56:13.066172 6389 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:13.066457 6389 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:13.069850 6389 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3077569f0774b0888e7e156265806a0: Sending DeleteTablet for 3 replicas of tablet 388ba28c157c4eed846b732398a1315a
I20260811 18:56:13.071023 6623 tablet_service.cc:1514] Processing DeleteTablet for tablet 388ba28c157c4eed846b732398a1315a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:13 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:38330
I20260811 18:56:13.071024 7078 tablet_service.cc:1514] Processing DeleteTablet for tablet 388ba28c157c4eed846b732398a1315a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:13 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:43176
I20260811 18:56:13.071142 6855 tablet_service.cc:1514] Processing DeleteTablet for tablet 388ba28c157c4eed846b732398a1315a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:13 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:41450
I20260811 18:56:13.078981 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 6526
I20260811 18:56:13.083581 7250 tablet_replica.cc:330] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: stopping tablet replica
I20260811 18:56:13.084218 7250 raft_consensus.cc:2229] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:13.084945 7250 raft_consensus.cc:2258] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:13.087606 7250 ts_tablet_manager.cc:1905] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:13.096261 7250 ts_tablet_manager.cc:1918] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:13.096557 7250 log.cc:1196] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/388ba28c157c4eed846b732398a1315a
I20260811 18:56:13.097219 7250 ts_tablet_manager.cc:1939] T 388ba28c157c4eed846b732398a1315a P 08a8ab7fe40d4cda84c2067ee12d6c09: Deleting consensus metadata
I20260811 18:56:13.099319 6365 catalog_manager.cc:4841] TS 08a8ab7fe40d4cda84c2067ee12d6c09 (127.19.155.194:33787): tablet 388ba28c157c4eed846b732398a1315a (table test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]) successfully deleted
I20260811 18:56:13.102671 7249 tablet_replica.cc:330] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: stopping tablet replica
I20260811 18:56:13.103221 7249 raft_consensus.cc:2229] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:13.103799 7249 raft_consensus.cc:2258] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:13.106186 7249 ts_tablet_manager.cc:1905] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 18:56:13 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:56:13.113976 7249 ts_tablet_manager.cc:1918] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:13.114162 7249 log.cc:1196] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/388ba28c157c4eed846b732398a1315a
I20260811 18:56:13.114856 7249 ts_tablet_manager.cc:1939] T 388ba28c157c4eed846b732398a1315a P 7af13bcdfdf348ae98583f71ca77f633: Deleting consensus metadata
I20260811 18:56:13.115376 7247 tablet_replica.cc:330] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: stopping tablet replica
I20260811 18:56:13.115834 7247 raft_consensus.cc:2229] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:56:13.116498 7247 raft_consensus.cc:2258] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:13.116891 6366 catalog_manager.cc:4841] TS 7af13bcdfdf348ae98583f71ca77f633 (127.19.155.193:40897): tablet 388ba28c157c4eed846b732398a1315a (table test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]) successfully deleted
I20260811 18:56:13.117569 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:13.080785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38342 (local address 127.19.155.193:40897)
0811 18:56:13.081016 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:13.081026 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:13.096044 (+ 15018us) server_negotiation.cc:407] Connection header received
0811 18:56:13.096599 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:13.096606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:13.096699 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:13.096791 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:13.098752 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.099890 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.101444 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.102342 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.102506 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:13.108482 (+ 5976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:13.108497 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:13.108513 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:13.108566 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:13.113320 (+ 4754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.114336 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.114347 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.114353 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.114528 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.115184 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.115189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.115192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.115735 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:13.116112 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:13.117051 (+ 939us) server_negotiation.cc:299] Negotiation successful
0811 18:56:13.117318 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:56:13.119030 6716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:56:13.120536 7247 ts_tablet_manager.cc:1905] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:13.133147 7247 ts_tablet_manager.cc:1918] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:13.133325 7247 log.cc:1196] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/388ba28c157c4eed846b732398a1315a
I20260811 18:56:13.133827 7247 ts_tablet_manager.cc:1939] T 388ba28c157c4eed846b732398a1315a P abfa17cfca5647b5843ce44c78364886: Deleting consensus metadata
I20260811 18:56:13.135685 6368 catalog_manager.cc:4841] TS abfa17cfca5647b5843ce44c78364886 (127.19.155.195:45325): tablet 388ba28c157c4eed846b732398a1315a (table test-table [id=a0c5ba6eb8e34760b4757c89cef3cd76]) successfully deleted
I20260811 18:56:13.262390 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 6526
I20260811 18:56:13.286134 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 6731
Aug 11 18:56:13 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:56:13.302390 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:13.286979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41454 (local address 127.19.155.194:33787)
0811 18:56:13.287157 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:13.287165 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:13.287187 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:56:13.287404 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:13.287410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:13.287488 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:13.287595 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:13.288929 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.289683 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.291071 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.291630 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.291776 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:13.296283 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:13.296299 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:13.296316 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:13.296364 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:13.299506 (+ 3142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.300233 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.300241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.300243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.300374 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.300802 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.300806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.300808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.301154 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:13.301472 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:13.301807 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 18:56:13.302043 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:56:13.303087 6952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:56:13.404928 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 6731
I20260811 18:56:13.437731 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 6971
Aug 11 18:56:13 dist-test-slave-1nl6 krb5kdc[5616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:56:13.456811 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:13.438813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43196 (local address 127.19.155.195:45325)
0811 18:56:13.439103 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:13.439109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:13.439133 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:56:13.439207 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:13.439213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:13.439296 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:13.439440 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:13.440700 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.441964 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.443476 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:13.444198 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:13.444352 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:13.449013 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:13.449029 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:13.449055 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:13.449118 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:13.453399 (+ 4281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.454400 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.454412 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.454418 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.454617 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:13.455104 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:13.455109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:13.455113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:13.455488 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:13.455817 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:13.456141 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:56:13.456400 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260811 18:56:13.457726 7178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:56:13.583685 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 6971
I20260811 18:56:13.612346 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 6339
I20260811 18:56:13.613636 6438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:56:13.727933 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 6339
I20260811 18:56:13.763945 20079 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:56:14.109126 20079 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:56:14.109447 20079 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:56:14.462709 20079 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:56:14.463 UTC [5664] LOG: received smart shutdown request
2026-08-11 18:56:14.467 UTC [5664] LOG: background worker "logical replication launcher" (PID 5686) exited with exit code 1
2026-08-11 18:56:14.467 UTC [5673] LOG: shutting down
2026-08-11 18:56:14.625 UTC [5664] LOG: database system is shut down
2026-08-11T18:56:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51038 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:56:14 dist-test-slave-1nl6 krb5kdc[7274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:56:14 dist-test-slave-1nl6 krb5kdc[7274](info): set up 2 sockets
Aug 11 18:56:14 dist-test-slave-1nl6 krb5kdc[7274](info): commencing operation
krb5kdc: starting...
W20260811 18:56:16.118891 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:56:16 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:56:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:16Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangeradmin_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangeradmin_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangerlookup_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangerlookup_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
I20260811 18:56:16.499362 20079 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskVECISF/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/postgres -l logfile start
2026-08-11 18:56:18.959 UTC [7330] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:56:18.959 UTC [7330] LOG: listening on IPv4 address "127.19.155.212", port 54015
2026-08-11 18:56:18.962 UTC [7330] LOG: listening on Unix socket "/tmp/.s.PGSQL.54015"
2026-08-11 18:56:18.985 UTC [7336] LOG: database system was shut down at 2026-08-11 18:56:17 UTC
2026-08-11 18:56:18.989 UTC [7330] LOG: database system is ready to accept connections
I20260811 18:56:20.198880 20079 mini_postgres.cc:96] Postgres bound to 54015
2026-08-11 18:56:20.222 UTC [7351] FATAL: database "slave" does not exist
127.19.155.212:54015 - accepting connections
I20260811 18:56:20.223138 20079 mini_ranger.cc:161] Starting Ranger...
I20260811 18:56:20.253608 20079 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:56:20.720630 20079 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:56:20.720764 20079 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin
2026-08-11 18:56:21,028 [I] DB FLAVOR :POSTGRES
2026-08-11 18:56:21,029 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:56:21,029 [I] Checking connection..
2026-08-11 18:56:21,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:56:21,278 [I] Checking connection passed.
2026-08-11 18:56:21,279 [I] --------- Verifying version history table ---------
2026-08-11 18:56:21,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:56:21,522 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:56:21,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:56:21,774 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:56:21,775 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:56:21,775 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:56:22.031 UTC [7459] WARNING: there is no transaction in progress
2026-08-11 18:56:22,041 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:56:22,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:56:22,295 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:56:22,296 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:56:22,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:56:22,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:56:22,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1nl6.c.gcp-upstream.internal','N') ;"
2026-08-11 18:56:23,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:56:23,299 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:56:23,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:56:23,546 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:56:23,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:56:23,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:56:24,024 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:56:24,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:56:24.982 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:24.998 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.014 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.028 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.043 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.060 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.112 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.119 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.132 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.142 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.152 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.166 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.176 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.183 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.189 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25.195 UTC [7635] WARNING: there is no transaction in progress
2026-08-11 18:56:25,813 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:56:25,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:56:26,047 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:56:26,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:56:26,306 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:56:26,306 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:56:26,571 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:56:26,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:56:26,829 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:56:27,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1nl6.c.gcp-upstream.internal';"
2026-08-11 18:56:27,338 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:56:27,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:56:27,594 [I] DB_PATCHES have already been applied
I20260811 18:56:27.600922 20079 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskVECISF/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:56:27.601011 20079 mini_ranger.cc:193] Using host: 127.19.155.212
I20260811 18:56:27.622198 20079 mini_ranger.cc:227] Ranger admin URL: http://127.19.155.212:60881
Aug 11, 2026 6:56:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:56:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:56:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:56:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:56:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:56:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:56:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:56:29.049233 20079 mini_ranger.cc:160] Time spent starting Ranger: real 8.826s user 0.000s sys 0.060s
Aug 11, 2026 6:56:48 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:56:48 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:56:48 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:56:48 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:56:49 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:56:49.872071 20079 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.155.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.155.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangerkms_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.155.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/rangerkms_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.155.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.155.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.155.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/HTTP_127.19.155.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:56:50 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474610, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:56:50.089627 20079 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:56:50.119889 20079 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:56:50.920580 20079 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:56:50.920795 20079 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms
I20260811 18:56:50.920850 20079 mini_ranger_kms.cc:227] Using postgres at 127.19.155.212:54015
2026-08-11 18:56:51,299 [I] DB FLAVOR :POSTGRES
2026-08-11 18:56:51,299 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:56:51,299 [I] Checking connection
2026-08-11 18:56:51,299 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:56:51,556 [I] connection success
2026-08-11 18:56:51,556 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:56:51,556 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:56:51,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:56:51,803 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:56:51,803 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:56:51,804 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:56:51,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.155.212:54015/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:56:52,094 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:56:52.568423 20079 mini_ranger_kms.cc:310] Created kms service
I20260811 18:56:52.761451 20079 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:56:52.807163 20079 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:56:52 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474610, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:53.238816 20079 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:56:53.239213 20079 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms:/tmp/dist-test-taskVECISF/build/asan/bin/postgresql.jar:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskVECISF/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:56:53.239285 20079 mini_ranger_kms.cc:240] Using host: 127.19.155.212
I20260811 18:56:53.262946 20079 mini_ranger_kms.cc:276] Ranger KMS PID: 7917
I20260811 18:56:53.263098 20079 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.155.212:60039
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:56:54 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:56:55 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:56.100826 20079 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.011s user 0.086s sys 0.328s
I20260811 18:56:56.101097 20079 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:56:56.101269 20079 mini_ranger_kms.cc:401] 127.19.155.212:60039/kms/v1/keys
Aug 11 18:56:56 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
Aug 11 18:56:56 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474615, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.155.212@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
Aug 11 18:56:58 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:56:58.846740 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34163
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34163
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:59.207798 8005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:59.208199 8005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:59.208359 8005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:59.215830 8005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:59.216001 8005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:59.216107 8005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:59.216209 8005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:59.216300 8005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:59.226994 8005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.155.212:60039/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34163
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:56:59.228451 8005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:59.229839 8005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:59.242476 8011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:59.242434 8013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:59.242508 8015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:59.243443 8005 server_base.cc:1034] running on GCE node
I20260811 18:56:59.244323 8005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:59.245872 8005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:59.247080 8005 hybrid_clock.cc:648] HybridClock initialized: now 1786474619247036 us; error 40 us; skew 500 ppm
I20260811 18:56:59.247531 8005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:56:59 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:59.257055 8005 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:56:59.258805 8005 webserver.cc:460] Webserver started at http://127.19.155.254:36025/ using document root <none> and password file <none>
I20260811 18:56:59.259580 8005 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:59.259735 8005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:59.260077 8005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:56:59 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:56:59.324285 8005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "a3769571f8374164b6b0506055ca6b63"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-1nl6"
server_key: "cf6c6a8479d0e227c53e44127e6569f9"
server_key_iv: "2c8112e06d528c3d24e9bd3121191b12"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:59.325445 8005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "a3769571f8374164b6b0506055ca6b63"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-1nl6"
server_key: "cf6c6a8479d0e227c53e44127e6569f9"
server_key_iv: "2c8112e06d528c3d24e9bd3121191b12"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:59.332829 8005 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
I20260811 18:56:59.354151 8024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:59.355962 8005 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:56:59.356176 8005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "a3769571f8374164b6b0506055ca6b63"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-1nl6"
server_key: "cf6c6a8479d0e227c53e44127e6569f9"
server_key_iv: "2c8112e06d528c3d24e9bd3121191b12"
server_key_version: "kuduclusterkey@0"
I20260811 18:56:59.356444 8005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:59.377480 8005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:59.383188 8005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:59.383572 8005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:59.404901 8005 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34163
I20260811 18:56:59.404861 8098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34163 every 8 connection(s)
I20260811 18:56:59.406788 8005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:59.411137 8099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:59.411392 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8005
I20260811 18:56:59.411633 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:56:59.412569 20079 external_mini_cluster.cc:1428] Setting key e54640ae53fac80def146e38544f43d3
I20260811 18:56:59.427762 8099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Bootstrap starting.
Aug 11 18:56:59 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:56:59.431840 8099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:59.433329 8099 log.cc:824] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:59.438228 8099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: No bootstrap required, opened a new log
I20260811 18:56:59.440379 8104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:59.414768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44070 (local address 127.19.155.254:34163)
0811 18:56:59.415685 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:59.415702 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:59.415763 (+ 61us) server_negotiation.cc:407] Connection header received
0811 18:56:59.418130 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:59.418165 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:59.418699 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:59.419237 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:59.421081 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:59.423184 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:59.425163 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:59.426271 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:59.426483 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:59.431700 (+ 5217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:59.431719 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:59.431740 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:59.431827 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:59.436188 (+ 4361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:59.437008 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:59.437036 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:59.437048 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:59.437223 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:59.437617 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:59.437623 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:59.437627 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:59.438139 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:59.438462 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:59.438931 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 18:56:59.439369 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":434,"threads_started":1}
I20260811 18:56:59.448269 8099 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:56:59.448695 8099 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:59.448808 8099 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3769571f8374164b6b0506055ca6b63, State: Initialized, Role: FOLLOWER
I20260811 18:56:59.449383 8099 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:56:59.449625 8099 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:59.449775 8099 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:59.449956 8099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:59.452234 8099 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:56:59.452782 8099 leader_election.cc:302] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3769571f8374164b6b0506055ca6b63; no voters:
I20260811 18:56:59.453397 8099 leader_election.cc:288] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:59.453641 8111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:59.454584 8111 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 LEADER]: Becoming Leader. State: Replica: a3769571f8374164b6b0506055ca6b63, State: Running, Role: LEADER
I20260811 18:56:59.455156 8111 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:56:59.455511 8099 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:59.458153 8113 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3769571f8374164b6b0506055ca6b63. Latest consensus state: current_term: 1 leader_uuid: "a3769571f8374164b6b0506055ca6b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } } }
I20260811 18:56:59.458915 8112 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3769571f8374164b6b0506055ca6b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } } }
I20260811 18:56:59.459316 8112 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:59.460412 8127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:59.460877 8113 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:59.466490 8127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:59.467340 8099 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:56:59.487501 8127 catalog_manager.cc:1347] Generated new cluster ID: 9acb8a03d2354ef6b8515885e4ea8c7a
I20260811 18:56:59.487655 8127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:59.525168 8127 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:59.526626 8127 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:59.544682 8127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Generated new TSK 0
I20260811 18:56:59.545924 8127 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:57:00.274178 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:00 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:57:00.726722 8171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.727295 8171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.727542 8171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.739657 8171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.739818 8171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.740067 8171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:00.756513 8171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:00.758447 8171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.760370 8171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:00.779291 8185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.779268 8186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.792294 8171 server_base.cc:1034] running on GCE node
W20260811 18:57:00.795302 8191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.796485 8171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.798954 8171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.800314 8171 hybrid_clock.cc:648] HybridClock initialized: now 1786474620800197 us; error 108 us; skew 500 ppm
I20260811 18:57:00.800856 8171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:00 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:00.806193 8171 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:00.812991 8171 webserver.cc:460] Webserver started at http://127.19.155.193:36391/ using document root <none> and password file <none>
I20260811 18:57:00.814229 8171 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.814492 8171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.815032 8171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:57:00 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:00.835006 8171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "40b03f4f61c14375967ef5a275fed426"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-1nl6"
server_key: "695accf63d7eeed0d03121d38c5b71b1"
server_key_iv: "9f27c6fdda6c82e93919d875d9a6abaa"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:00.836023 8171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "40b03f4f61c14375967ef5a275fed426"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-1nl6"
server_key: "695accf63d7eeed0d03121d38c5b71b1"
server_key_iv: "9f27c6fdda6c82e93919d875d9a6abaa"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:00.844913 8171 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260811 18:57:00.871076 8201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.873332 8171 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 18:57:00.873687 8171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "40b03f4f61c14375967ef5a275fed426"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-1nl6"
server_key: "695accf63d7eeed0d03121d38c5b71b1"
server_key_iv: "9f27c6fdda6c82e93919d875d9a6abaa"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:00.874087 8171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.952725 8171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.958926 8171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.959470 8171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.975466 8171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:00.984203 8171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:00.984421 8171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:00.984649 8171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:00.984791 8171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:01 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:01.295032 8171 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36455
I20260811 18:57:01.295106 8374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36455 every 8 connection(s)
I20260811 18:57:01.296931 8171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:01.298197 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8171
I20260811 18:57:01.298413 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:01.299256 20079 external_mini_cluster.cc:1428] Setting key 4370e6dc1754c4fafa1b0bf9a6715b9b
Aug 11 18:57:01 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:01.339509 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.302086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57385 (local address 127.19.155.254:34163)
0811 18:57:01.315067 (+ 12981us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.315074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.316364 (+ 1290us) server_negotiation.cc:407] Connection header received
0811 18:57:01.319122 (+ 2758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.319130 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.319244 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.319366 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:01.321851 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.323724 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.326412 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.327124 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.327243 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.331993 (+ 4750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:01.332000 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:01.332004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:01.332047 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:01.335439 (+ 3392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:01.336468 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:01.336474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:01.336477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:01.336636 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:01.337207 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:01.337212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:01.337216 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:01.337617 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:01.337748 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.338824 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.339102 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12824,"thread_start_us":12649,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
I20260811 18:57:01.342257 8377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.301461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.193:57385)
0811 18:57:01.315751 (+ 14290us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.315826 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.318580 (+ 2754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.319898 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.319912 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.320661 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:01.321591 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.321625 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.323970 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.323975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.326200 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.326218 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.327653 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.327661 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.327970 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.328856 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:01.328889 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:01.331704 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:01.335670 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:01.335681 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:01.335701 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:01.336296 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:01.336787 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:01.336794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:01.336800 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:01.337063 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:01.337859 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:01.337867 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:01.338375 (+ 508us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.340128 (+ 1753us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.340753 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13925,"thread_start_us":13671,"threads_started":1}
I20260811 18:57:01.344941 8375 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:01.345252 8375 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:01.346244 8375 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:01.349355 8050 ts_manager.cc:194] Registered new tserver with Master: 40b03f4f61c14375967ef5a275fed426 (127.19.155.193:36455)
I20260811 18:57:01.351544 8050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:57385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:57:01.396494 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:01 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
W20260811 18:57:01.925467 8387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:01.925931 8387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:01.926101 8387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:01.938051 8387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:01.938252 8387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:01.938462 8387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:01.953331 8387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:01.955253 8387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:01.956907 8387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:01.974116 8409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.974180 8412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.974638 8408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:01.976747 8387 server_base.cc:1034] running on GCE node
I20260811 18:57:01.977630 8387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:01.979045 8387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:01.980373 8387 hybrid_clock.cc:648] HybridClock initialized: now 1786474621980245 us; error 117 us; skew 500 ppm
I20260811 18:57:01.980798 8387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:01 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:01.984972 8387 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:01.986790 8387 webserver.cc:460] Webserver started at http://127.19.155.194:41169/ using document root <none> and password file <none>
I20260811 18:57:01.987638 8387 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:01.987802 8387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:01.988137 8387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:57:01 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:02.007004 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "7c80f81d139d4c3fadd8312eb28a7ba3"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-1nl6"
server_key: "b337eaf3df2bde812526050039ce4cd0"
server_key_iv: "3ebea5228a8c8c8b59e14e8452a9a63e"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.008283 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "7c80f81d139d4c3fadd8312eb28a7ba3"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-1nl6"
server_key: "b337eaf3df2bde812526050039ce4cd0"
server_key_iv: "3ebea5228a8c8c8b59e14e8452a9a63e"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.016346 8387 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260811 18:57:02.036257 8422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.038318 8387 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:57:02.038554 8387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "7c80f81d139d4c3fadd8312eb28a7ba3"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-1nl6"
server_key: "b337eaf3df2bde812526050039ce4cd0"
server_key_iv: "3ebea5228a8c8c8b59e14e8452a9a63e"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.038857 8387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:02.065999 8387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:02.072011 8387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:02.072417 8387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:02.073755 8387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:02.075943 8387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:02.076057 8387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.076205 8387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:02.076277 8387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.112372 8387 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44857
I20260811 18:57:02.112382 8598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44857 every 8 connection(s)
I20260811 18:57:02.114238 8387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:02.120569 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8387
I20260811 18:57:02.120766 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:02.121385 20079 external_mini_cluster.cc:1428] Setting key 991dc0d9f501f4ab0f0c2f2a13e466fa
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:02.137322 8601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.117437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:59581 (local address 127.19.155.254:34163)
0811 18:57:02.117991 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:02.117997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:02.119274 (+ 1277us) server_negotiation.cc:407] Connection header received
0811 18:57:02.121337 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:02.121342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:02.121484 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:02.121611 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:02.123942 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.124715 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.126436 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.126864 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.127072 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.130854 (+ 3782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:02.130859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:02.130863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:02.130945 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:02.133779 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.134663 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.134679 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.134682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.134811 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.135339 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.135345 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.135348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.135662 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:02.135840 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:02.136632 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 18:57:02.136921 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":321,"threads_started":1}
I20260811 18:57:02.138454 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.118139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.194:59581)
0811 18:57:02.119073 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:02.119131 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:02.121017 (+ 1886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:02.122110 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:02.122124 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:02.122729 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:02.123729 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:02.123764 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.124885 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.124890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:02.126250 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:02.126275 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.127187 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.127194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:02.127480 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.128301 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:02.128339 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:02.130575 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:02.133969 (+ 3394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:02.133980 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:02.134006 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:02.134523 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:02.134963 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:02.134968 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:02.134972 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:02.135214 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:02.135820 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:02.135829 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:02.136228 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 18:57:02.136526 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 18:57:02.137117 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":370,"threads_started":1}
I20260811 18:57:02.151204 8599 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:02.151634 8599 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:02.152762 8599 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:02.154855 8050 ts_manager.cc:194] Registered new tserver with Master: 7c80f81d139d4c3fadd8312eb28a7ba3 (127.19.155.194:44857)
I20260811 18:57:02.156122 8050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:59581
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:57:02.206837 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:02.355785 8375 heartbeater.cc:503] Master 127.19.155.254:34163 was elected leader, sending a full tablet report...
W20260811 18:57:02.604125 8610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:02.604424 8610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:02.604521 8610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:02.611752 8610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:02.611868 8610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:02.611980 8610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:02.621906 8610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:02.623270 8610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:02.624531 8610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:02.638340 8623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:02.638430 8624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:02.638494 8626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:02.639267 8610 server_base.cc:1034] running on GCE node
I20260811 18:57:02.639886 8610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:02.640936 8610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:02.642202 8610 hybrid_clock.cc:648] HybridClock initialized: now 1786474622642141 us; error 42 us; skew 500 ppm
I20260811 18:57:02.642561 8610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:02.646142 8610 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:02.647668 8610 webserver.cc:460] Webserver started at http://127.19.155.195:44059/ using document root <none> and password file <none>
I20260811 18:57:02.648392 8610 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:02.648530 8610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:02.648845 8610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:02.664819 8610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "248815b658b74f359e9a35bf84d747f1"
format_stamp: "Formatted at 2026-08-11 18:57:02 on dist-test-slave-1nl6"
server_key: "d0d817f0aab0f9eb5eae30138721cdc9"
server_key_iv: "dfc0a202172c9c04cb43f6fab2781325"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.665707 8610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "248815b658b74f359e9a35bf84d747f1"
format_stamp: "Formatted at 2026-08-11 18:57:02 on dist-test-slave-1nl6"
server_key: "d0d817f0aab0f9eb5eae30138721cdc9"
server_key_iv: "dfc0a202172c9c04cb43f6fab2781325"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.671543 8610 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 18:57:02.688421 8638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.690055 8610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:02.690274 8610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "248815b658b74f359e9a35bf84d747f1"
format_stamp: "Formatted at 2026-08-11 18:57:02 on dist-test-slave-1nl6"
server_key: "d0d817f0aab0f9eb5eae30138721cdc9"
server_key_iv: "dfc0a202172c9c04cb43f6fab2781325"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:02.690523 8610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:02.744467 8610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:02.748522 8610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:02.748829 8610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:02.749852 8610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:02.751335 8610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:02.751441 8610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.751590 8610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:02.751662 8610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:02.786600 8610 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:35623
I20260811 18:57:02.786645 8800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:35623 every 8 connection(s)
I20260811 18:57:02.787968 8610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:02.793155 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8610
I20260811 18:57:02.793358 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:02.793824 20079 external_mini_cluster.cc:1428] Setting key faf23dda809ad3c174841a39ad0be7e3
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:02.807480 8803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.790677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59619 (local address 127.19.155.254:34163)
0811 18:57:02.791241 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:02.791246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:02.792171 (+ 925us) server_negotiation.cc:407] Connection header received
0811 18:57:02.794112 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:02.794118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:02.794229 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:02.794350 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:02.795942 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.796699 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.798226 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.798663 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.798792 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.802057 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:02.802062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:02.802065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:02.802095 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:02.804539 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.805251 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.805261 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.805263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.805382 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.805815 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.805820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.805828 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.806065 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:02.806232 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:02.806881 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 18:57:02.807125 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":308,"threads_started":1}
I20260811 18:57:02.808550 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.791295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.195:59619)
0811 18:57:02.791982 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:02.792026 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:02.793799 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:02.794614 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:02.794626 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:02.795140 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:02.795776 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:02.795796 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.796861 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.796865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:02.798083 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:02.798095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.798885 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.798894 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:02.799153 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.799825 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:02.799847 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:02.801845 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:02.804696 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:02.804704 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:02.804722 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:02.805100 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:02.805490 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:02.805495 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:02.805499 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:02.805698 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:02.806214 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:02.806222 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:02.806508 (+ 286us) client_negotiation.cc:769] Sending connection context
0811 18:57:02.806763 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 18:57:02.807245 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":293,"threads_started":1}
I20260811 18:57:02.809902 8801 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:02.810173 8801 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:02.810792 8801 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:02.812292 8050 ts_manager.cc:194] Registered new tserver with Master: 248815b658b74f359e9a35bf84d747f1 (127.19.155.195:35623)
I20260811 18:57:02.813051 8050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:59619
I20260811 18:57:02.821136 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:02.822815 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8171
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:57:02.839020 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.823755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.19.155.193:36455)
0811 18:57:02.824420 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:02.824426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:02.824451 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:57:02.824510 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:02.824516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:02.824705 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:02.824830 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:02.826429 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.827556 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.828890 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.829408 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.829513 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.833592 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:02.833604 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:02.833617 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:02.833650 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:02.836506 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.837175 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.837182 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.837184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.837343 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.837673 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.837676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.837678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.838000 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:02.838246 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:02.838491 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 18:57:02.838686 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":316,"threads_started":1}
I20260811 18:57:02.840318 8366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:02.923282 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8171
I20260811 18:57:02.945815 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8387
Aug 11 18:57:02 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:57:02.962736 8810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:02.946774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.19.155.194:44857)
0811 18:57:02.947422 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:02.947429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:02.947455 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:02.947519 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:02.947525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:02.947743 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:02.947872 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:02.949110 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.950131 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.951595 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:02.952189 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:02.952298 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:02.956879 (+ 4581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:02.956891 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:02.956907 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:02.956948 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:02.959686 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.960388 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.960396 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.960399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.960535 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:02.961005 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:02.961009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:02.961012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:02.961383 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:02.961697 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:02.962073 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 18:57:02.962374 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":374,"threads_started":1}
I20260811 18:57:02.964123 8593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:03.047248 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8387
I20260811 18:57:03.078511 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8610
Aug 11 18:57:03 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:57:03.098127 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:03.079690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52538 (local address 127.19.155.195:35623)
0811 18:57:03.080409 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:03.080417 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:03.080447 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:57:03.080510 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:03.080517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:03.080731 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:03.080863 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:03.082260 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.083356 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.084608 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.085150 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.085271 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:03.092628 (+ 7357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:03.092639 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:03.092654 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:03.092690 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:03.095636 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.096292 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.096299 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.096301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.096430 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.096758 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.096761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.096762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.097075 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:03.097326 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:03.097538 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 18:57:03.097722 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":375,"threads_started":1}
I20260811 18:57:03.099516 8794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:03.194375 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8610
I20260811 18:57:03.234326 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8005
I20260811 18:57:03.235839 8091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:03.343055 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8005
I20260811 18:57:03.383242 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34163
--webserver_interface=127.19.155.254
--webserver_port=36025
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34163
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:03.738212 8818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:03.738548 8818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:03.738644 8818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:03.746225 8818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:03.746352 8818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:03.746399 8818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:03.746456 8818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:03.746506 8818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:03.757241 8818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34163
--ranger_config_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=36025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:03.758522 8818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:03.759866 8818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:03.771862 8832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:03.771919 8833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:03.771942 8835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:03.773058 8818 server_base.cc:1034] running on GCE node
I20260811 18:57:03.773922 8818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:03.775605 8818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:03.776839 8818 hybrid_clock.cc:648] HybridClock initialized: now 1786474623776773 us; error 65 us; skew 500 ppm
I20260811 18:57:03.777205 8818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:03 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474623, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:03.780473 8818 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:03.782052 8818 webserver.cc:460] Webserver started at http://127.19.155.254:36025/ using document root <none> and password file <none>
I20260811 18:57:03.782718 8818 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:03.782830 8818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:57:03 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474623, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:03.867820 8818 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:57:03.871076 8856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:03.872573 8818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:03.872790 8818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "a3769571f8374164b6b0506055ca6b63"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-1nl6"
server_key: "cf6c6a8479d0e227c53e44127e6569f9"
server_key_iv: "2c8112e06d528c3d24e9bd3121191b12"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:03.873823 8818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:03.889919 8818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:03.893805 8818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:03.894112 8818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:03.913005 8818 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34163
I20260811 18:57:03.913029 8928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34163 every 8 connection(s)
I20260811 18:57:03.914625 8818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:03.922314 8929 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:57:03.923832 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8818
I20260811 18:57:03.924763 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:36455
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:34163
--webserver_port=36391
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:03.926000 8929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Bootstrap starting.
I20260811 18:57:03.949232 8929 log.cc:824] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:03.962654 8929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:57:03.963375 8929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Bootstrap complete.
I20260811 18:57:03.977723 8929 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:57:03.978995 8929 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3769571f8374164b6b0506055ca6b63, State: Initialized, Role: FOLLOWER
I20260811 18:57:03.979782 8929 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:57:03.980059 8929 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:03.980214 8929 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:03.980414 8929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:57:03.986095 8929 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:57:03.986717 8929 leader_election.cc:302] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3769571f8374164b6b0506055ca6b63; no voters:
I20260811 18:57:03.987416 8929 leader_election.cc:288] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:57:03.987603 8935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:57:03.988921 8935 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [term 2 LEADER]: Becoming Leader. State: Replica: a3769571f8374164b6b0506055ca6b63, State: Running, Role: LEADER
I20260811 18:57:03.989477 8935 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } }
I20260811 18:57:03.989655 8929 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:03.992012 8938 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3769571f8374164b6b0506055ca6b63. Latest consensus state: current_term: 2 leader_uuid: "a3769571f8374164b6b0506055ca6b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } } }
I20260811 18:57:03.992393 8938 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:04.003607 8937 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a3769571f8374164b6b0506055ca6b63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3769571f8374164b6b0506055ca6b63" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34163 } } }
I20260811 18:57:04.004004 8937 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:04.004346 8944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:04.010371 8944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:04.011926 8944 catalog_manager.cc:1259] Loaded cluster ID: 9acb8a03d2354ef6b8515885e4ea8c7a
I20260811 18:57:04.012095 8944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:04.016358 8944 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:04.017916 8944 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Loaded TSK: 0
I20260811 18:57:04.019627 8944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:04.024498 8929 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 18:57:04.435741 8933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:04.436311 8933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:04.436523 8933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:04.448585 8933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:04.448828 8933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:04.449097 8933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:04.465796 8933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:36455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=36391
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:04.467964 8933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:04.469995 8933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:04.490245 8995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:04.490677 8993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:04.490522 8997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:04.491185 8933 server_base.cc:1034] running on GCE node
I20260811 18:57:04.492120 8933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:04.493571 8933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:04.494853 8933 hybrid_clock.cc:648] HybridClock initialized: now 1786474624494762 us; error 97 us; skew 500 ppm
I20260811 18:57:04.495365 8933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:04 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:04.502066 8933 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:04.504060 8933 webserver.cc:460] Webserver started at http://127.19.155.193:36391/ using document root <none> and password file <none>
I20260811 18:57:04.505203 8933 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:04.505376 8933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:57:04 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:04.538563 8933 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:57:04.542558 9010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:04.544484 8933 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:57:04.544764 8933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "40b03f4f61c14375967ef5a275fed426"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-1nl6"
server_key: "695accf63d7eeed0d03121d38c5b71b1"
server_key_iv: "9f27c6fdda6c82e93919d875d9a6abaa"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:04.546375 8933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:04.583876 8933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:04.589460 8933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:04.589897 8933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:04.591259 8933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:04.593405 8933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:04.593528 8933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:04.593652 8933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:04.593756 8933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:04.667351 8933 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36455
I20260811 18:57:04.667416 9202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36455 every 8 connection(s)
I20260811 18:57:04.669173 8933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:04.679355 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 8933
I20260811 18:57:04.680415 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:44857
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:34163
--webserver_port=41169
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:04 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474624, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:04.714025 9206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:04.673114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:41189 (local address 127.19.155.254:34163)
0811 18:57:04.677419 (+ 4305us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:04.677445 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:04.681735 (+ 4290us) server_negotiation.cc:407] Connection header received
0811 18:57:04.685902 (+ 4167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:04.685931 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:04.686565 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:04.687092 (+ 527us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:04.690147 (+ 3055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.692332 (+ 2185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.695290 (+ 2958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.696544 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.696751 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:04.702248 (+ 5497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:04.702263 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:04.702288 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:04.702354 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:04.706781 (+ 4427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:04.708173 (+ 1392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:04.708188 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:04.708213 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:04.708506 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:04.709302 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:04.709308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:04.709311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:04.710131 (+ 820us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:04.710357 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:04.711786 (+ 1429us) server_negotiation.cc:299] Negotiation successful
0811 18:57:04.712373 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3939,"thread_start_us":3652,"threads_started":1}
I20260811 18:57:04.717176 9208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:04.673250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.193:41189)
0811 18:57:04.681455 (+ 8205us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:04.681533 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:04.684920 (+ 3387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:04.688061 (+ 3141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:04.688073 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:04.688822 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:04.689834 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:04.689874 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.692706 (+ 2832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.692712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:04.695000 (+ 2288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:04.695036 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.697326 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.697338 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:04.697681 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:04.698632 (+ 951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:04.698670 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:04.701812 (+ 3142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:04.707127 (+ 5315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:04.707141 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:04.707161 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:04.707933 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:04.708748 (+ 815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:04.708755 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:04.708760 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:04.709105 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:04.710533 (+ 1428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:04.710544 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:04.711099 (+ 555us) client_negotiation.cc:769] Sending connection context
0811 18:57:04.714651 (+ 3552us) client_negotiation.cc:240] Negotiation successful
0811 18:57:04.715482 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7797,"thread_start_us":7565,"threads_started":1}
I20260811 18:57:04.724475 9203 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:04.724889 9203 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:04.725937 9203 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
W20260811 18:57:04.730187 9203 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:34163 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:57:04.730481 9203 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:04.730813 9203 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:04.732547 9203 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:04.732896 9203 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
W20260811 18:57:04.734385 9203 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:57:05.115391 9210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:05.115702 9210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:05.115869 9210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:05.125712 9210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:05.125941 9210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:05.126137 9210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:05.142310 9210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:44857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=41169
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:05.144104 9210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:05.145998 9210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:05.166380 9230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:05.166373 9229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:05.171435 9210 server_base.cc:1034] running on GCE node
W20260811 18:57:05.171818 9234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:05.172724 9210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:05.173918 9210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:05.175137 9210 hybrid_clock.cc:648] HybridClock initialized: now 1786474625175069 us; error 61 us; skew 500 ppm
I20260811 18:57:05.175506 9210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:05.179126 9210 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:05.184449 9210 webserver.cc:460] Webserver started at http://127.19.155.194:41169/ using document root <none> and password file <none>
I20260811 18:57:05.185359 9210 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:05.185531 9210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:05.225456 9210 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.001s sys 0.006s
I20260811 18:57:05.228967 9254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:05.230849 9210 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 18:57:05.231166 9210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "7c80f81d139d4c3fadd8312eb28a7ba3"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-1nl6"
server_key: "b337eaf3df2bde812526050039ce4cd0"
server_key_iv: "3ebea5228a8c8c8b59e14e8452a9a63e"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:05.232780 9210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:05.283159 9210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:05.289099 9210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:05.289440 9210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:05.290935 9210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:05.292945 9210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:05.293069 9210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:05.293208 9210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:05.293298 9210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:05.373353 9210 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44857
I20260811 18:57:05.373430 9436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44857 every 8 connection(s)
I20260811 18:57:05.375532 9210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:05.383734 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 9210
I20260811 18:57:05.384807 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.155.212:60039/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:35623
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:34163
--webserver_port=44059
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:05.417546 9440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:05.379242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39431 (local address 127.19.155.254:34163)
0811 18:57:05.395393 (+ 16151us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:05.395399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:05.395419 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:57:05.395489 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:05.395494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:05.395575 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:05.395705 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:05.397723 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:05.398494 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:05.403594 (+ 5100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:05.404313 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:05.404422 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:05.409290 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:05.409298 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:05.409303 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:05.409351 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:05.413198 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:05.414398 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:05.414405 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:05.414408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:05.414581 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:05.415225 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:05.415231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:05.415235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:05.415632 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:05.415781 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:05.416872 (+ 1091us) server_negotiation.cc:299] Negotiation successful
0811 18:57:05.417125 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16014,"thread_start_us":17253,"threads_started":1}
I20260811 18:57:05.420100 9441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:05.380203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.194:39431)
0811 18:57:05.392610 (+ 12407us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:05.392660 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:05.394475 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:05.396227 (+ 1752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:05.396240 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:05.396887 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:05.397516 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:05.397534 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:05.398695 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:05.398700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:05.403371 (+ 4671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:05.403391 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:05.404824 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:05.404832 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:05.405140 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:05.406025 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:05.406064 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:05.408949 (+ 2885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:05.413467 (+ 4518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:05.413478 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:05.413499 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:05.414226 (+ 727us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:05.414748 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:05.414753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:05.414756 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:05.415066 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:05.415886 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:05.415897 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:05.416410 (+ 513us) client_negotiation.cc:769] Sending connection context
0811 18:57:05.417903 (+ 1493us) client_negotiation.cc:240] Negotiation successful
0811 18:57:05.418564 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12061,"thread_start_us":14488,"threads_started":1}
I20260811 18:57:05.422120 9437 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:05.422523 9437 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:05.423550 9437 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:05.425920 8883 ts_manager.cc:194] Registered new tserver with Master: 7c80f81d139d4c3fadd8312eb28a7ba3 (127.19.155.194:44857)
I20260811 18:57:05.428099 8883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:39431
I20260811 18:57:05.734539 9203 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:05.735011 9203 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:05.736236 8883 ts_manager.cc:194] Registered new tserver with Master: 40b03f4f61c14375967ef5a275fed426 (127.19.155.193:36455)
I20260811 18:57:05.737316 8883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:41189
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
W20260811 18:57:05.856526 9442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:05.857105 9442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:05.857321 9442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:05.868950 9442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:05.869171 9442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:05.869410 9442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:05.884495 9442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.155.212:60039/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:35623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=44059
--tserver_master_addrs=127.19.155.254:34163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:05.886179 9442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:05.887909 9442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:05.906167 9450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:05.908012 9451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:05.909335 9453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:05.909494 9442 server_base.cc:1034] running on GCE node
I20260811 18:57:05.910241 9442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:05.911384 9442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:05.912647 9442 hybrid_clock.cc:648] HybridClock initialized: now 1786474625912565 us; error 67 us; skew 500 ppm
I20260811 18:57:05.913049 9442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:05.917601 9442 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:05.922545 9442 webserver.cc:460] Webserver started at http://127.19.155.195:44059/ using document root <none> and password file <none>
I20260811 18:57:05.923434 9442 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:05.923610 9442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:57:05 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:05.948694 9442 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:57:05.958056 9464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:05.959726 9442 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.006s sys 0.004s
I20260811 18:57:05.959951 9442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "248815b658b74f359e9a35bf84d747f1"
format_stamp: "Formatted at 2026-08-11 18:57:02 on dist-test-slave-1nl6"
server_key: "d0d817f0aab0f9eb5eae30138721cdc9"
server_key_iv: "dfc0a202172c9c04cb43f6fab2781325"
server_key_version: "kuduclusterkey@0"
I20260811 18:57:05.961027 9442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:05.983788 9442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:05.988230 9442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:05.988538 9442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:05.989730 9442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:05.991448 9442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:05.991571 9442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:05.991711 9442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:05.991811 9442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:06.045784 9442 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:35623
I20260811 18:57:06.045823 9658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:35623 every 8 connection(s)
I20260811 18:57:06.047556 9442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:06.056975 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 9442
Aug 11 18:57:06 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:06.093238 9671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.058271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44072 (local address 127.19.155.254:34163)
0811 18:57:06.073817 (+ 15546us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.073821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.073837 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:57:06.073892 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.073896 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.074017 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.074139 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.077271 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.078123 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.080578 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.081258 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.081380 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.085414 (+ 4034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.085422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.085428 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:06.085472 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.089349 (+ 3877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.090669 (+ 1320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.090674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.090678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.090914 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.091405 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.091411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.091415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.091816 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.092089 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.092566 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.092812 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15429,"thread_start_us":15284,"threads_started":1}
I20260811 18:57:06.103178 9666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.055864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34163 (local address 127.19.155.195:49675)
0811 18:57:06.072403 (+ 16539us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.072453 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.080087 (+ 7634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.081209 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.081223 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.081896 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:06.082880 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.082937 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.085083 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.085088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.087606 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.087646 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.089123 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.089132 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.089461 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.090307 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:06.090342 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:06.094146 (+ 3804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:06.098600 (+ 4454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:06.098609 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:06.098627 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:06.099222 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:06.099602 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:06.099607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:06.099611 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:06.099830 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:06.100405 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:06.100414 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:06.100762 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.101059 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.101650 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16193,"thread_start_us":15933,"threads_started":1}
I20260811 18:57:06.104337 9664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.055307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:49675 (local address 127.19.155.254:34163)
0811 18:57:06.069303 (+ 13996us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.069310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.072624 (+ 3314us) server_negotiation.cc:407] Connection header received
0811 18:57:06.080441 (+ 7817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.080446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.080554 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.080659 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.083171 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.084880 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.087830 (+ 2950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.088579 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.088702 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.094588 (+ 5886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.094595 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.094599 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:06.094634 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.098464 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.099360 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.099365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.099369 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.099491 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.099964 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.099969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.099973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.100245 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.100416 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.103718 (+ 3302us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.103966 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13847,"thread_start_us":13693,"threads_started":1}
I20260811 18:57:06.106274 9661 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34163
I20260811 18:57:06.106662 9661 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:06.107638 9661 heartbeater.cc:511] Master 127.19.155.254:34163 requested a full tablet report, sending...
I20260811 18:57:06.109647 8881 ts_manager.cc:194] Registered new tserver with Master: 248815b658b74f359e9a35bf84d747f1 (127.19.155.195:35623)
I20260811 18:57:06.111019 8881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:49675
I20260811 18:57:06.122803 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:57:06 dist-test-slave-1nl6 krb5kdc[7274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474625, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for HTTP/127.19.155.212@KRBTEST.COM
I20260811 18:57:06.168408 9664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.130772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.19.155.254:34163)
0811 18:57:06.131032 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.131041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.138419 (+ 7378us) server_negotiation.cc:407] Connection header received
0811 18:57:06.138804 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.138811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.138988 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.139078 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.146671 (+ 7593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.147896 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.154113 (+ 6217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.154849 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.155026 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.160864 (+ 5838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.160872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.160878 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:06.160929 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.164710 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.165859 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.165866 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.165871 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.166039 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.166493 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.166499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.166503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.166945 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.167214 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.167803 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.168038 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:57:06.174718 8881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:06.186599 8881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:06.288128 9698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.277188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:35623 (local address 127.0.0.1:52550)
0811 18:57:06.277832 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.277854 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.277986 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.278770 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.278778 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.278809 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:06.279376 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.279397 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.281592 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.281599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.284262 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.284278 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.287013 (+ 2735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.287022 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.287248 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.287305 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.287461 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.287671 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":5,"thread_start_us":354,"threads_started":1}
I20260811 18:57:06.289196 9699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.277549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52550 (local address 127.19.155.195:35623)
0811 18:57:06.278262 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.278267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.278292 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:57:06.278367 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.278372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.278535 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.278754 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:06.279668 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.281391 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.284494 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.285983 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.286569 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.286770 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.288606 (+ 1836us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.288826 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":390,"threads_started":1}
I20260811 18:57:06.294046 9544 tablet_service.cc:1467] Processing CreateTablet for tablet 767a84608ba742009a147c22bf36addf (DEFAULT_TABLE table=test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:06.295852 9544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767a84608ba742009a147c22bf36addf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:06.297092 9696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.239596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36455 (local address 127.0.0.1:52196)
0811 18:57:06.253364 (+ 13768us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.253417 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.253615 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.279226 (+ 25611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.279232 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.279265 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:06.279689 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.279703 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.282513 (+ 2810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.282519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.284722 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.284738 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.296163 (+ 11425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.296171 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.296352 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.296388 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.296496 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.296654 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13487,"mutex_wait_us":24,"thread_start_us":37092,"threads_started":1}
I20260811 18:57:06.298107 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.249899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44857 (local address 127.0.0.1:60906)
0811 18:57:06.276985 (+ 27086us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.277006 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.277150 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.281956 (+ 4806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.281961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.281992 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:06.284851 (+ 2859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.284859 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.286823 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.286827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.294048 (+ 7221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.294068 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.297261 (+ 3193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.297268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.297465 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.297500 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.297581 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.297713 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26941,"mutex_wait_us":2416,"thread_start_us":3009,"threads_started":1}
I20260811 18:57:06.298883 9697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.250571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60906 (local address 127.19.155.194:44857)
0811 18:57:06.275420 (+ 24849us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.275429 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.278186 (+ 2757us) server_negotiation.cc:407] Connection header received
0811 18:57:06.278297 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.278305 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.278538 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.278754 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:06.285039 (+ 6285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.286653 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.296096 (+ 9443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.297025 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.297219 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.297403 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.298372 (+ 969us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.298555 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24653,"thread_start_us":24536,"threads_started":1}
I20260811 18:57:06.302958 9336 tablet_service.cc:1467] Processing CreateTablet for tablet 767a84608ba742009a147c22bf36addf (DEFAULT_TABLE table=test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:06.304324 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.240269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52196 (local address 127.19.155.193:36455)
0811 18:57:06.275965 (+ 35696us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.275974 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.276006 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:57:06.276121 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.276130 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.276463 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.279877 (+ 3414us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:06.280135 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.281772 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.288586 (+ 6814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.295143 (+ 6557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.295398 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.295563 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.303774 (+ 8211us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.303982 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35508,"thread_start_us":35325,"threads_started":1}
I20260811 18:57:06.304469 9336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767a84608ba742009a147c22bf36addf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:06.318974 9093 tablet_service.cc:1467] Processing CreateTablet for tablet 767a84608ba742009a147c22bf36addf (DEFAULT_TABLE table=test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:06.320644 9093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 767a84608ba742009a147c22bf36addf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:06.335752 9703 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Bootstrap starting.
I20260811 18:57:06.339211 9700 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Bootstrap starting.
I20260811 18:57:06.345813 9700 tablet_bootstrap.cc:654] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:06.348773 9703 tablet_bootstrap.cc:654] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:06.349400 9707 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Bootstrap starting.
I20260811 18:57:06.350311 9703 log.cc:824] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:06.353272 9707 tablet_bootstrap.cc:654] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:06.354185 9700 log.cc:824] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:06.354519 9707 log.cc:824] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:06.366510 9700 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: No bootstrap required, opened a new log
I20260811 18:57:06.369215 9703 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: No bootstrap required, opened a new log
I20260811 18:57:06.369601 9703 ts_tablet_manager.cc:1397] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.006s
I20260811 18:57:06.371198 9700 ts_tablet_manager.cc:1397] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.000s
I20260811 18:57:06.393177 9707 tablet_bootstrap.cc:492] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: No bootstrap required, opened a new log
I20260811 18:57:06.393605 9707 ts_tablet_manager.cc:1397] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.030s
I20260811 18:57:06.400699 9700 raft_consensus.cc:348] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.401247 9700 raft_consensus.cc:374] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:06.401365 9700 raft_consensus.cc:729] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248815b658b74f359e9a35bf84d747f1, State: Initialized, Role: FOLLOWER
I20260811 18:57:06.404445 9707 raft_consensus.cc:348] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.404980 9707 raft_consensus.cc:374] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:06.405151 9707 raft_consensus.cc:729] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b03f4f61c14375967ef5a275fed426, State: Initialized, Role: FOLLOWER
I20260811 18:57:06.406057 9707 consensus_queue.cc:260] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.407510 9703 raft_consensus.cc:348] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.407941 9703 raft_consensus.cc:374] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:06.408056 9703 raft_consensus.cc:729] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c80f81d139d4c3fadd8312eb28a7ba3, State: Initialized, Role: FOLLOWER
I20260811 18:57:06.411580 9703 consensus_queue.cc:260] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.412547 9700 consensus_queue.cc:260] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.420785 9661 heartbeater.cc:503] Master 127.19.155.254:34163 was elected leader, sending a full tablet report...
I20260811 18:57:06.421926 9700 ts_tablet_manager.cc:1428] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Time spent starting tablet: real 0.051s user 0.009s sys 0.007s
I20260811 18:57:06.422385 9203 heartbeater.cc:503] Master 127.19.155.254:34163 was elected leader, sending a full tablet report...
I20260811 18:57:06.422847 9437 heartbeater.cc:503] Master 127.19.155.254:34163 was elected leader, sending a full tablet report...
I20260811 18:57:06.423398 9707 ts_tablet_manager.cc:1428] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Time spent starting tablet: real 0.030s user 0.017s sys 0.011s
W20260811 18:57:06.423887 9204 tablet.cc:2369] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:06.425077 9703 ts_tablet_manager.cc:1428] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Time spent starting tablet: real 0.055s user 0.014s sys 0.002s
W20260811 18:57:06.571617 9662 tablet.cc:2369] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:57:06.634508 9438 tablet.cc:2369] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:06.653751 9715 raft_consensus.cc:482] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:06.654045 9715 raft_consensus.cc:504] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.655757 9715 leader_election.cc:288] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40b03f4f61c14375967ef5a275fed426 (127.19.155.193:36455), 248815b658b74f359e9a35bf84d747f1 (127.19.155.195:35623)
I20260811 18:57:06.663208 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.656148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:49017 (local address 127.19.155.193:36455)
0811 18:57:06.656425 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.656435 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.657093 (+ 658us) server_negotiation.cc:407] Connection header received
0811 18:57:06.657341 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.657347 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.657450 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.657571 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:06.658181 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.658947 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.661229 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.662163 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.662351 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.662433 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.662757 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.662901 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:57:06.663622 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.657085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:35623 (local address 127.19.155.194:34683)
0811 18:57:06.657770 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.657785 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.657935 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.658249 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.658253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.658275 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:06.658611 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.658619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.659621 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.659627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.661092 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.661105 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.662780 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.662786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.662974 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.663006 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.663099 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.663231 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":25,"thread_start_us":443,"threads_started":1}
I20260811 18:57:06.663698 9699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.657329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:34683 (local address 127.19.155.195:35623)
0811 18:57:06.657537 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.657543 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.657868 (+ 325us) server_negotiation.cc:407] Connection header received
0811 18:57:06.658082 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.658085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.658143 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.658234 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:06.658754 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.659488 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.661335 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.662535 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.662689 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.662759 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.663175 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.663322 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:57:06.664445 9729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.656044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36455 (local address 127.19.155.194:49017)
0811 18:57:06.656971 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:06.656994 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:06.657155 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:06.657605 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:06.657613 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:06.657644 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:06.658024 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.658035 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.659094 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.659100 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.661064 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:06.661080 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.662385 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.662391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:06.662552 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.662576 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:57:06.663598 (+ 1022us) client_negotiation.cc:240] Negotiation successful
0811 18:57:06.664039 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":23,"thread_start_us":598,"threads_started":1}
I20260811 18:57:06.664625 9584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767a84608ba742009a147c22bf36addf" candidate_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248815b658b74f359e9a35bf84d747f1" is_pre_election: true
I20260811 18:57:06.665230 9584 raft_consensus.cc:2454] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c80f81d139d4c3fadd8312eb28a7ba3 in term 0.
I20260811 18:57:06.665477 9128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767a84608ba742009a147c22bf36addf" candidate_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40b03f4f61c14375967ef5a275fed426" is_pre_election: true
I20260811 18:57:06.665913 9256 leader_election.cc:302] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248815b658b74f359e9a35bf84d747f1, 7c80f81d139d4c3fadd8312eb28a7ba3; no voters:
I20260811 18:57:06.665995 9128 raft_consensus.cc:2454] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c80f81d139d4c3fadd8312eb28a7ba3 in term 0.
I20260811 18:57:06.666352 9715 raft_consensus.cc:2781] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:06.666517 9715 raft_consensus.cc:482] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:06.666656 9715 raft_consensus.cc:3037] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:06.668905 9715 raft_consensus.cc:504] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.669515 9715 leader_election.cc:288] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [CANDIDATE]: Term 1 election: Requested vote from peers 40b03f4f61c14375967ef5a275fed426 (127.19.155.193:36455), 248815b658b74f359e9a35bf84d747f1 (127.19.155.195:35623)
I20260811 18:57:06.669860 9128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767a84608ba742009a147c22bf36addf" candidate_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40b03f4f61c14375967ef5a275fed426"
I20260811 18:57:06.670032 9584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "767a84608ba742009a147c22bf36addf" candidate_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "248815b658b74f359e9a35bf84d747f1"
I20260811 18:57:06.670069 9128 raft_consensus.cc:3037] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:06.670436 9584 raft_consensus.cc:3037] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:06.672669 9584 raft_consensus.cc:2454] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c80f81d139d4c3fadd8312eb28a7ba3 in term 1.
I20260811 18:57:06.673049 9256 leader_election.cc:302] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 248815b658b74f359e9a35bf84d747f1, 7c80f81d139d4c3fadd8312eb28a7ba3; no voters:
I20260811 18:57:06.673342 9715 raft_consensus.cc:2781] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:06.673465 9128 raft_consensus.cc:2454] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c80f81d139d4c3fadd8312eb28a7ba3 in term 1.
I20260811 18:57:06.673856 9715 raft_consensus.cc:686] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 1 LEADER]: Becoming Leader. State: Replica: 7c80f81d139d4c3fadd8312eb28a7ba3, State: Running, Role: LEADER
I20260811 18:57:06.674351 9715 consensus_queue.cc:237] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } }
I20260811 18:57:06.678803 8881 catalog_manager.cc:5495] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c80f81d139d4c3fadd8312eb28a7ba3 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c80f81d139d4c3fadd8312eb28a7ba3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44857 } health_report { overall_health: HEALTHY } } }
I20260811 18:57:06.704557 9697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.698684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60908 (local address 127.19.155.194:44857)
0811 18:57:06.698936 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.698945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.699301 (+ 356us) server_negotiation.cc:407] Connection header received
0811 18:57:06.699543 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.699548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.699640 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.699802 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:06.700238 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.700957 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.702409 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.702811 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.702969 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.703449 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:06.703930 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:06.704124 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.704186 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.704278 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:57:06.712661 9128 raft_consensus.cc:1261] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 1 FOLLOWER]: Refusing update from remote peer 7c80f81d139d4c3fadd8312eb28a7ba3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:06.712651 9584 raft_consensus.cc:1261] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 1 FOLLOWER]: Refusing update from remote peer 7c80f81d139d4c3fadd8312eb28a7ba3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:06.713637 9715 consensus_queue.cc:1035] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40b03f4f61c14375967ef5a275fed426" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:06.713979 9731 consensus_queue.cc:1035] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "248815b658b74f359e9a35bf84d747f1" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:06.743942 8881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:06.744158 8881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:06.747388 8881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3769571f8374164b6b0506055ca6b63: Sending DeleteTablet for 3 replicas of tablet 767a84608ba742009a147c22bf36addf
I20260811 18:57:06.748553 9336 tablet_service.cc:1514] Processing DeleteTablet for tablet 767a84608ba742009a147c22bf36addf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:06 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:60906
I20260811 18:57:06.748600 9093 tablet_service.cc:1514] Processing DeleteTablet for tablet 767a84608ba742009a147c22bf36addf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:06 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:52196
I20260811 18:57:06.748931 9544 tablet_service.cc:1514] Processing DeleteTablet for tablet 767a84608ba742009a147c22bf36addf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:06 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:52550
I20260811 18:57:06.752687 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8933
I20260811 18:57:06.760597 9758 tablet_replica.cc:330] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: stopping tablet replica
I20260811 18:57:06.761674 9758 raft_consensus.cc:2229] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:06.762825 9758 raft_consensus.cc:2258] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:06.763875 9752 tablet_replica.cc:330] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: stopping tablet replica
I20260811 18:57:06.764129 9756 tablet_replica.cc:330] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: stopping tablet replica
I20260811 18:57:06.764457 9752 raft_consensus.cc:2229] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:06.764536 9756 raft_consensus.cc:2229] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:06.765434 9756 raft_consensus.cc:2258] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:06.766158 9752 raft_consensus.cc:2258] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:06.767249 9758 ts_tablet_manager.cc:1905] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:06.768011 9756 ts_tablet_manager.cc:1905] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:06.776015 9756 ts_tablet_manager.cc:1918] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:06.776230 9756 log.cc:1196] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/767a84608ba742009a147c22bf36addf
I20260811 18:57:06.776881 9756 ts_tablet_manager.cc:1939] T 767a84608ba742009a147c22bf36addf P 40b03f4f61c14375967ef5a275fed426: Deleting consensus metadata
I20260811 18:57:06.777401 9752 ts_tablet_manager.cc:1905] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:06.779063 9695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.754759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52198 (local address 127.19.155.193:36455)
0811 18:57:06.755009 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.755019 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.757642 (+ 2623us) server_negotiation.cc:407] Connection header received
0811 18:57:06.757849 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.757858 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.757977 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.758106 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.762719 (+ 4613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.764095 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.766228 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.766928 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.767039 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.770641 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.770655 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.770673 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:06.770714 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.774874 (+ 4160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.775868 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.775878 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.775881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.776069 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.776610 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.776618 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.776624 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.777213 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.777522 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.778220 (+ 698us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.778480 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:57:06.779224 8861 catalog_manager.cc:4841] TS 40b03f4f61c14375967ef5a275fed426 (127.19.155.193:36455): tablet 767a84608ba742009a147c22bf36addf (table test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]) successfully deleted
I20260811 18:57:06.780158 9193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:06.780567 9758 ts_tablet_manager.cc:1918] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:06.780828 9758 log.cc:1196] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/767a84608ba742009a147c22bf36addf
I20260811 18:57:06.781407 9758 ts_tablet_manager.cc:1939] T 767a84608ba742009a147c22bf36addf P 248815b658b74f359e9a35bf84d747f1: Deleting consensus metadata
I20260811 18:57:06.783149 8861 catalog_manager.cc:4841] TS 248815b658b74f359e9a35bf84d747f1 (127.19.155.195:35623): tablet 767a84608ba742009a147c22bf36addf (table test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]) successfully deleted
I20260811 18:57:06.785786 9752 ts_tablet_manager.cc:1918] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:06.785998 9752 log.cc:1196] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/767a84608ba742009a147c22bf36addf
I20260811 18:57:06.786598 9752 ts_tablet_manager.cc:1939] T 767a84608ba742009a147c22bf36addf P 7c80f81d139d4c3fadd8312eb28a7ba3: Deleting consensus metadata
I20260811 18:57:06.788230 8863 catalog_manager.cc:4841] TS 7c80f81d139d4c3fadd8312eb28a7ba3 (127.19.155.194:44857): tablet 767a84608ba742009a147c22bf36addf (table test-table [id=620e8e25a34f4aaa95e2205a09ba3bb8]) successfully deleted
I20260811 18:57:06.874831 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8933
I20260811 18:57:06.909777 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 9210
I20260811 18:57:06.928444 9697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.910809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60912 (local address 127.19.155.194:44857)
0811 18:57:06.911059 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.911064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.911079 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:57:06.911448 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.911459 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.911553 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.911698 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.913412 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.914710 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.916569 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:06.917276 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:06.917417 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:06.920645 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.920663 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.920708 (+ 45us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:06.920753 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.925061 (+ 4308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.925960 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.925971 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.925975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.926141 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:06.926570 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:06.926576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:06.926579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:06.927212 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.927566 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.927804 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.928044 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 18:57:06.929227 9430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:07.043663 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 9210
I20260811 18:57:07.070230 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 9442
I20260811 18:57:07.084547 9699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:07.071123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52566 (local address 127.19.155.195:35623)
0811 18:57:07.071307 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:07.071311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:07.071380 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:57:07.071587 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:07.071591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:07.071661 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:07.071757 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:07.073320 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.074081 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.075651 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.076063 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.076181 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:07.079102 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:07.079118 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:07.079147 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:07.079186 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:07.081900 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.082570 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.082576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.082579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.082705 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.083238 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.083241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.083243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.083603 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:07.083826 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:07.084104 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 18:57:07.084281 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:57:07.085204 9651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:07.171903 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 9442
I20260811 18:57:07.200246 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 8818
I20260811 18:57:07.201433 8922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:07.313633 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 8818
I20260811 18:57:07.349730 20079 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:57:07.695001 20079 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:57:07.695218 20079 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:57:08.051438 20079 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:57:08.051 UTC [7330] LOG: received smart shutdown request
2026-08-11 18:57:08.054 UTC [7330] LOG: background worker "logical replication launcher" (PID 7347) exited with exit code 1
2026-08-11 18:57:08.055 UTC [7342] LOG: shutting down
2026-08-11 18:57:08.202 UTC [7330] LOG: database system is shut down
2026-08-11T18:57:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53567 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:08 dist-test-slave-1nl6 krb5kdc[9781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:08 dist-test-slave-1nl6 krb5kdc[9781](info): set up 2 sockets
Aug 11 18:57:08 dist-test-slave-1nl6 krb5kdc[9781](info): commencing operation
krb5kdc: starting...
W20260811 18:57:09.665148 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:57:09 dist-test-slave-1nl6 krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:57:09.940658 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38409
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:10.288481 9799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:10.288784 9799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:10.288877 9799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:10.296279 9799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:10.296476 9799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:10.296583 9799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:10.296696 9799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:10.296783 9799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:10.306891 9799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:10.308439 9799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:10.309840 9799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:10.322386 9805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:10.322352 9810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:10.322278 9806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:10.323504 9799 server_base.cc:1034] running on GCE node
I20260811 18:57:10.324357 9799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:10.325846 9799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:10.327067 9799 hybrid_clock.cc:648] HybridClock initialized: now 1786474630327018 us; error 47 us; skew 500 ppm
I20260811 18:57:10.327445 9799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:10 dist-test-slave-1nl6 krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:10.336445 9799 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:10.338054 9799 webserver.cc:460] Webserver started at http://127.19.155.254:42537/ using document root <none> and password file <none>
I20260811 18:57:10.338786 9799 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:10.338965 9799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:10.339298 9799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:10.342370 9799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "dad32e90f1ce49aba82c3e2610ea3167"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "f38a8aa0b05e94b91d3b84ad4ddddf98"
server_key_iv: "f959764db5efd08a689fea17ecdb76d2"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.343267 9799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "dad32e90f1ce49aba82c3e2610ea3167"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "f38a8aa0b05e94b91d3b84ad4ddddf98"
server_key_iv: "f959764db5efd08a689fea17ecdb76d2"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.348650 9799 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 18:57:10.352376 9820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:10.353737 9799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:57:10.353948 9799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "dad32e90f1ce49aba82c3e2610ea3167"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "f38a8aa0b05e94b91d3b84ad4ddddf98"
server_key_iv: "f959764db5efd08a689fea17ecdb76d2"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.354168 9799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:10.372179 9799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:10.376328 9799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:10.376643 9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:10.396164 9799 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:38409
I20260811 18:57:10.396198 9904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:38409 every 8 connection(s)
I20260811 18:57:10.397655 9799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:10.398679 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 9799
I20260811 18:57:10.398970 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:57:10.399928 20079 external_mini_cluster.cc:1428] Setting key d9a0a08a9a74be933711ae8767f7f5b2
I20260811 18:57:10.402092 9905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:10.408854 9905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:10 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.155.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.253@KRBTEST.COM" created.
I20260811 18:57:10.433218 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.413357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35448 (local address 127.19.155.254:38409)
0811 18:57:10.414127 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:10.414137 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:10.414196 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:57:10.415513 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:10.415524 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:10.415847 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:10.416079 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:10.417259 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.419305 (+ 2046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.420713 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.421776 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.421996 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.425409 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:10.425422 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:10.425444 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:10.425486 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:10.429078 (+ 3592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.429767 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.429774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.429776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.429929 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.430310 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.430318 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.430323 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.430979 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:10.431199 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:10.431829 (+ 630us) server_negotiation.cc:299] Negotiation successful
0811 18:57:10.432118 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"spinlock_wait_cycles":28928,"thread_start_us":311,"threads_started":1}
I20260811 18:57:10.433269 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.412010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38409 (local address 127.0.0.1:35448)
0811 18:57:10.412894 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.412951 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:10.415127 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:10.416105 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:10.416110 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:10.416674 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:10.417023 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.417040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.419472 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.419476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.420557 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.420570 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.422006 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.422011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.422136 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.422874 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:10.422945 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:10.425131 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:10.429234 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.429244 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.429254 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.429646 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.430025 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.430029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.430031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.430180 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.431121 (+ 941us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:10.431129 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:10.431390 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 18:57:10.431710 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 18:57:10.432346 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":68,"thread_start_us":383,"threads_started":1}
I20260811 18:57:10.436630 9905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:10.437696 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.437313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39646)
0811 18:57:10.437479 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.437585 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 18:57:10.437928 9822 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
I20260811 18:57:10.439581 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.439225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39648)
0811 18:57:10.439375 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.439446 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 18:57:10.439761 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:34403: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
I20260811 18:57:10.464510 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:34403
--webserver_interface=127.19.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:10.489274 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } attempt: 1
I20260811 18:57:10.490617 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.490135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39656)
0811 18:57:10.490356 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.490485 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 18:57:10.491719 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.491356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39662)
0811 18:57:10.491508 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.491587 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 18:57:10.491909 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:34403: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
I20260811 18:57:10.560142 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } attempt: 2
I20260811 18:57:10.561367 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.560879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39668)
0811 18:57:10.561113 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.561222 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 18:57:10.562603 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.562099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39670)
0811 18:57:10.562315 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.562405 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260811 18:57:10.562805 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:34403: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
I20260811 18:57:10.654130 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } attempt: 3
I20260811 18:57:10.655402 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.654933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39686)
0811 18:57:10.655146 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.655268 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 18:57:10.656555 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.656185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39698)
0811 18:57:10.656333 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.656409 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:57:10.656769 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:34403: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
I20260811 18:57:10.800086 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } attempt: 4
I20260811 18:57:10.801440 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.800892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39700)
0811 18:57:10.801209 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.801299 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260811 18:57:10.802562 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.802131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39710)
0811 18:57:10.802341 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.802436 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:57:10.802747 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:34403: Network error: Client connection negotiation failed: client connection to 127.19.155.253:34403: connect: Connection refused (error 111)
W20260811 18:57:10.820159 9913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:10.820569 9913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:10.820732 9913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:10.828685 9913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:10.828868 9913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:10.828980 9913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:10.829092 9913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:10.829200 9913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:10.839928 9913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:34403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:10.841506 9913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:10.843017 9913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:10.855702 9919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:10.855664 9924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:10.855602 9922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:10.856561 9913 server_base.cc:1034] running on GCE node
I20260811 18:57:10.857440 9913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:10.859118 9913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:10.860355 9913 hybrid_clock.cc:648] HybridClock initialized: now 1786474630860294 us; error 59 us; skew 500 ppm
I20260811 18:57:10.860739 9913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:10 dist-test-slave-1nl6 krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:10.864284 9913 init.cc:377] Logged in from keytab as kudu/127.19.155.253@KRBTEST.COM (short username kudu)
I20260811 18:57:10.865844 9913 webserver.cc:460] Webserver started at http://127.19.155.253:41981/ using document root <none> and password file <none>
I20260811 18:57:10.866598 9913 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:10.866755 9913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:10.867132 9913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:10.870280 9913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data/instance:
uuid: "f8e28f731c3c4c888fd833a7ab24898d"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "ce926647dcf1e2f5f551d3622d44be22"
server_key_iv: "88ddbda333c0541ae3be665195b22520"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.871227 9913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal/instance:
uuid: "f8e28f731c3c4c888fd833a7ab24898d"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "ce926647dcf1e2f5f551d3622d44be22"
server_key_iv: "88ddbda333c0541ae3be665195b22520"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.876842 9913 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:57:10.880822 9932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:10.882537 9913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:57:10.882769 9913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "f8e28f731c3c4c888fd833a7ab24898d"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-1nl6"
server_key: "ce926647dcf1e2f5f551d3622d44be22"
server_key_iv: "88ddbda333c0541ae3be665195b22520"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.883072 9913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:10.900092 9913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:10.905411 9913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:10.905754 9913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:10.925761 9913 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.253:34403
I20260811 18:57:10.925794 10005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.253:34403 every 8 connection(s)
I20260811 18:57:10.927371 9913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
I20260811 18:57:10.931382 10006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:10.933665 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 9913
I20260811 18:57:10.933911 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-1/wal/instance
I20260811 18:57:10.934401 20079 external_mini_cluster.cc:1428] Setting key e4b84c6df6dbc8dfdf7bf948076e9408
I20260811 18:57:10.938961 10006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:10 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.155.252@KRBTEST.COM; defaulting to no policy
I20260811 18:57:10.961894 10012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.941786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35452 (local address 127.19.155.254:38409)
0811 18:57:10.942359 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:10.942368 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:10.943481 (+ 1113us) server_negotiation.cc:407] Connection header received
0811 18:57:10.945522 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:10.945528 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:10.945635 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:10.945774 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:10.947564 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.948281 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.949894 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.950332 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.950476 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.954214 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:10.954223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:10.954231 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:10.954294 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:10.958217 (+ 3923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.959187 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.959194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.959200 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.959363 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.959801 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.959807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.959814 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.960255 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:10.960427 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:10.961180 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 18:57:10.961437 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":263,"threads_started":1}
I20260811 18:57:10.962703 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.942382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38409 (local address 127.0.0.1:35452)
0811 18:57:10.943272 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.943330 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:10.945211 (+ 1881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:10.946047 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:10.946057 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:10.946649 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:10.947352 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.947373 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.948466 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.948470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.949731 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.949744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.950595 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.950603 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.950840 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.951631 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:10.951656 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:10.953943 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:10.958439 (+ 4496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.958448 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.958464 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.959062 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.959480 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.959483 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.959485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.959660 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.960402 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:10.960409 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:10.960769 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 18:57:10.961005 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 18:57:10.961413 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":379,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.252@KRBTEST.COM" created.
I20260811 18:57:10.964704 10006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:10 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:57:10.980675 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.965434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39718)
0811 18:57:10.965716 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.965741 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:10.965859 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:10.966860 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:10.966869 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:10.967440 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:10.967657 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.967672 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.969050 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.969058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.970579 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:10.970598 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.971535 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.971540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:10.971775 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.972413 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:10.972431 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:10.974515 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:10.978109 (+ 3594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.978113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.978116 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.978498 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.978985 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:10.978988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:10.978991 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:10.979138 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:10.979939 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:10.979942 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:10.980057 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:57:10.980200 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 18:57:10.980411 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260811 18:57:10.981235 10015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.965647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.19.155.253:34403)
0811 18:57:10.966422 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:10.966428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:10.966454 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:10.966499 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:10.966505 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:10.966680 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:10.966806 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:10.967825 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.968898 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.970726 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:10.971372 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:10.971509 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:10.974748 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:10.974761 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:10.974777 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:10.974807 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:10.977948 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.978642 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.978655 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.978662 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.978827 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:10.979270 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:10.979277 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:10.979283 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:10.979804 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:10.980004 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:10.980402 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 18:57:10.980737 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":444,"threads_started":1}
I20260811 18:57:10.983906 10006 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:10.985054 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.984596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55418)
0811 18:57:10.984788 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.984904 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 18:57:10.985327 9934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:10.987074 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:10.986645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55426)
0811 18:57:10.986827 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:10.986955 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 18:57:10.987280 10006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
I20260811 18:57:11.000787 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:35565
--webserver_interface=127.19.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:37959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:11.036655 10006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 1
I20260811 18:57:11.037995 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.037418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55440)
0811 18:57:11.037660 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.037791 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 18:57:11.039220 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.038763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55450)
0811 18:57:11.038966 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.039058 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 18:57:11.039454 10006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.102015 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } attempt: 5
I20260811 18:57:11.107687 10006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 2
I20260811 18:57:11.108827 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.108303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55452)
0811 18:57:11.108523 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.108627 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:57:11.109902 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.109545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55460)
0811 18:57:11.109711 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.109792 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
W20260811 18:57:11.110208 10006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.116559 10015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.103029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39734 (local address 127.19.155.253:34403)
0811 18:57:11.103211 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.103218 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.103267 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:57:11.103498 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.103505 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.103594 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.103727 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.104585 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.105284 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.106442 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.106867 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.107038 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.111008 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.111013 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.111017 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.111049 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.113768 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.114663 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.114668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.114670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.114809 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.115279 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.115283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.115285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.115584 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.115707 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.116140 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.116346 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:57:11.116731 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.102892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39734)
0811 18:57:11.103174 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.103197 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.103349 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.103787 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.103792 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.104216 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.104407 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.104416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.105424 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.105431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.106286 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.106298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.107052 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.107058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.107294 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.108002 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.108032 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.110771 (+ 2739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.113990 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.113996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.114000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.114510 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.114961 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.114966 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.114969 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.115152 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.115715 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.115720 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.115895 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.116052 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.116383 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 18:57:11.117895 9905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:11.119020 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.118577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55474)
0811 18:57:11.118758 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.118835 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 18:57:11.120034 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.119674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55482)
0811 18:57:11.119843 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.119930 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 18:57:11.120322 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.171551 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 1
I20260811 18:57:11.172871 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.172369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55490)
0811 18:57:11.172588 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.172691 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 18:57:11.173981 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.173618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55504)
0811 18:57:11.173786 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.173861 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:57:11.174245 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.201475 10006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 3
I20260811 18:57:11.202679 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.202192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55514)
0811 18:57:11.202408 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.202513 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 18:57:11.203908 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.203473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55524)
0811 18:57:11.203716 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.203792 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
W20260811 18:57:11.204134 10006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.242486 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 2
I20260811 18:57:11.243855 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.243302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55532)
0811 18:57:11.243564 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.243672 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 18:57:11.244997 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.244610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55546)
0811 18:57:11.244778 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.244874 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:57:11.245287 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.347353 10006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 4
I20260811 18:57:11.348623 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.348067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55548)
0811 18:57:11.348323 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.348410 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:57:11.349725 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.349392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55562)
0811 18:57:11.349554 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.349619 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:57:11.349997 10006 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
I20260811 18:57:11.351557 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 3
I20260811 18:57:11.352600 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.352181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55568)
0811 18:57:11.352368 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.352455 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 18:57:11.353588 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.353248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55570)
0811 18:57:11.353398 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.353482 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:57:11.353816 9905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:35565: Network error: Client connection negotiation failed: client connection to 127.19.155.252:35565: connect: Connection refused (error 111)
W20260811 18:57:11.364513 10019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:11.364821 10019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:11.365011 10019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:11.372638 10019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:11.372761 10019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:11.372848 10019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:11.372941 10019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:11.373026 10019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:11.383435 10019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:37959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38409,127.19.155.253:34403,127.19.155.252:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:35565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:11.385005 10019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:11.386533 10019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:11.399823 10031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:11.399796 10034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:11.399940 10028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:11.401631 10019 server_base.cc:1034] running on GCE node
I20260811 18:57:11.402673 10019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:11.404352 10019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:11.405601 10019 hybrid_clock.cc:648] HybridClock initialized: now 1786474631405544 us; error 48 us; skew 500 ppm
I20260811 18:57:11.405979 10019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474631, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:11.409281 10019 init.cc:377] Logged in from keytab as kudu/127.19.155.252@KRBTEST.COM (short username kudu)
I20260811 18:57:11.411001 10019 webserver.cc:460] Webserver started at http://127.19.155.252:43829/ using document root <none> and password file <none>
I20260811 18:57:11.411763 10019 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:11.411918 10019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:11.412267 10019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:11.415611 10019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data/instance:
uuid: "f388c4a1c7a0435f989b31d948bbb866"
format_stamp: "Formatted at 2026-08-11 18:57:11 on dist-test-slave-1nl6"
server_key: "157d78d8836b765baee4f6121c5125d9"
server_key_iv: "6302ee98574c819bded39bcbe57d0325"
server_key_version: "encryptionkey@0"
I20260811 18:57:11.416467 10019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal/instance:
uuid: "f388c4a1c7a0435f989b31d948bbb866"
format_stamp: "Formatted at 2026-08-11 18:57:11 on dist-test-slave-1nl6"
server_key: "157d78d8836b765baee4f6121c5125d9"
server_key_iv: "6302ee98574c819bded39bcbe57d0325"
server_key_version: "encryptionkey@0"
I20260811 18:57:11.422049 10019 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 18:57:11.425673 10043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:11.427209 10019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:11.427410 10019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "f388c4a1c7a0435f989b31d948bbb866"
format_stamp: "Formatted at 2026-08-11 18:57:11 on dist-test-slave-1nl6"
server_key: "157d78d8836b765baee4f6121c5125d9"
server_key_iv: "6302ee98574c819bded39bcbe57d0325"
server_key_version: "encryptionkey@0"
I20260811 18:57:11.427624 10019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:11.441406 10019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:11.446533 10019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:11.446862 10019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:11.469509 10019 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.252:35565
I20260811 18:57:11.469511 10126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.252:35565 every 8 connection(s)
I20260811 18:57:11.471818 10019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
I20260811 18:57:11.476944 10127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:11.481748 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 10019
I20260811 18:57:11.482016 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474422014372-20079-0/minicluster-data/master-2/wal/instance
I20260811 18:57:11.482692 20079 external_mini_cluster.cc:1428] Setting key 3f5752f2a9415c7184cedc38367b0ff3
I20260811 18:57:11.486478 10127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474631, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 18:57:11.509001 10132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.490072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.19.155.254:38409)
0811 18:57:11.490702 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.490711 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.491273 (+ 562us) server_negotiation.cc:407] Connection header received
0811 18:57:11.491681 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.491687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.491781 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.491910 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.493317 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.494128 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.495772 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.496193 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.496352 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.500972 (+ 4620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.500978 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.500982 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.501030 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.505296 (+ 4266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.506312 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.506316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.506319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.506464 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.507037 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.507041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.507043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.507465 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.507616 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.508339 (+ 723us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.508602 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":313,"threads_started":1}
I20260811 18:57:11.510072 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.485902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.19.155.252:35565)
0811 18:57:11.487309 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.487324 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.487417 (+ 93us) server_negotiation.cc:407] Connection header received
0811 18:57:11.490890 (+ 3473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.490954 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.491471 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.491740 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.493486 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.494742 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.496272 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.496935 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.497088 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.502026 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.502035 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.502051 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.502086 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.505659 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.506595 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.506603 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.506607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.506787 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.507212 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.507216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.507220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.507888 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.508117 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.508552 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.508935 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":180,"server-negotiator.queue_time_us":1147,"thread_start_us":686,"threads_started":1}
I20260811 18:57:11.510116 10134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.490172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38409 (local address 127.0.0.1:35454)
0811 18:57:11.491109 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.491149 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.491416 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.491986 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.491993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.492699 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.493109 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.493128 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.494299 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.494311 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.495607 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.495620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.496460 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.496469 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.496799 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.497585 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.497609 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.500190 (+ 2581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.505490 (+ 5300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.505500 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.505517 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.506156 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.506616 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.506620 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.506622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.506894 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.507603 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.507610 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.507899 (+ 289us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.508230 (+ 331us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.508790 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":90,"thread_start_us":500,"threads_started":1}
I20260811 18:57:11.511905 10127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474631, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:11.525769 10134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.512629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:34403 (local address 127.0.0.1:39742)
0811 18:57:11.512853 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.512872 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.512971 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.513357 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.513363 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.513837 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.514047 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.514060 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.515074 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.515079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.516077 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.516093 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.516767 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.516773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.517002 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.517609 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.517632 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.519877 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.523383 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.523388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.523393 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.523760 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.524155 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.524160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.524163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.524314 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.524814 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.524818 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.524979 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.525121 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.525413 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 18:57:11.525803 10015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.512784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39742 (local address 127.19.155.253:34403)
0811 18:57:11.512991 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.512998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.513023 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:57:11.513085 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.513091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.513183 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.513293 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.514208 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.514879 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.516223 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.516627 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.516717 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.520066 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.520072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.520075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.520107 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.523248 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.523896 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.523902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.523906 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.524040 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.524424 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.524430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.524434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.524685 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.524842 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.525214 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.525428 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:57:11.526721 10127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:11.528650 10132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.513434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35470 (local address 127.19.155.254:38409)
0811 18:57:11.513607 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.513611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.513625 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:57:11.513783 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.513794 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.513858 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.513930 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.515328 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.515985 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.517621 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.518021 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.518176 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.522825 (+ 4649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.522829 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.522833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.522863 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.525512 (+ 2649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.526535 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.526543 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.526547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.526677 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.527117 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.527123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.527126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.527463 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.527751 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.528063 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.528299 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:57:11.531039 9905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 4
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474631, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:57:11.542857 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.527579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55590 (local address 127.19.155.252:35565)
0811 18:57:11.527725 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.527730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.527751 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:57:11.527782 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.527785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.527830 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.527932 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.528656 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.529562 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.531397 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.532860 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.532973 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.536786 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.536792 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.536797 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.536833 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.539872 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.540671 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.540679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.540683 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.540821 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.541248 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.541253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.541256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.541667 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.541834 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.542242 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.542593 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":51}
I20260811 18:57:11.542881 10134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.527349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55590)
0811 18:57:11.527504 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.527523 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.527616 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.527950 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.527954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.528318 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.528496 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.528509 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.529708 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.529713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.530901 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.530945 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.533113 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.533117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.533261 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.533878 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.533895 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.536599 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.540026 (+ 3427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.540032 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.540036 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.540557 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.540930 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.540935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.540938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.541114 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.541806 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.541812 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.541982 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.542098 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.542452 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 18:57:11.548630 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: Bootstrap starting.
I20260811 18:57:11.548894 10015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.530508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39750 (local address 127.19.155.253:34403)
0811 18:57:11.530695 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.530701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.530720 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:57:11.530771 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.530776 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.530858 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.531032 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.532935 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.534011 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.535733 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.536217 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.536363 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.542270 (+ 5907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.542276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.542281 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.542322 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.546047 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.546773 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.546780 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.546784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.547010 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.547402 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.547408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.547411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.547688 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.547984 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.548291 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.548537 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:57:11.553110 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.531596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55592)
0811 18:57:11.531759 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.531778 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.531875 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.532673 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.532680 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.533165 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.533382 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.533394 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.534774 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.534780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.536180 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.536196 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.537223 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.537229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.537427 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.538015 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.538037 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.540814 (+ 2777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.549940 (+ 9126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.549946 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.549949 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.550553 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.551146 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.551151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.551155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.551358 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.552030 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.552034 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.552233 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.552385 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.552690 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:57:11.553174 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.531755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55592 (local address 127.19.155.252:35565)
0811 18:57:11.532400 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.532404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.532421 (+ 17us) server_negotiation.cc:407] Connection header received
0811 18:57:11.532463 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.532466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.532516 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.532634 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.533565 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.534645 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.536333 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.537061 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.537213 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.541081 (+ 3868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.541090 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.541098 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.541135 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.549735 (+ 8600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.550767 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.550776 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.550781 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.551000 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.551542 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.551549 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.551553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.551893 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.552083 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.552475 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.552690 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":386,"threads_started":1}
I20260811 18:57:11.553279 10127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:11.554541 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:11.555100 10127 log.cc:824] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:11.558789 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: No bootstrap required, opened a new log
I20260811 18:57:11.558903 9905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: Bootstrap starting.
I20260811 18:57:11.561976 9905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:11.563234 9905 log.cc:824] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:11.567239 9905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: No bootstrap required, opened a new log
I20260811 18:57:11.571208 10127 raft_consensus.cc:348] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.571789 10127 raft_consensus.cc:374] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:11.571965 10127 raft_consensus.cc:729] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f388c4a1c7a0435f989b31d948bbb866, State: Initialized, Role: FOLLOWER
I20260811 18:57:11.572867 10127 consensus_queue.cc:260] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.579947 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.582397 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.582255 10127 sys_catalog.cc:564] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:11.585772 10132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.563887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.19.155.254:38409)
0811 18:57:11.564066 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.564073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.565498 (+ 1425us) server_negotiation.cc:407] Connection header received
0811 18:57:11.565786 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.565792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.565891 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.565967 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.568396 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.569603 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.571740 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.572506 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.572609 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.577447 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.577457 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.577464 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.577538 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.581557 (+ 4019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.582675 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.582682 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.582689 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.582869 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.583367 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.583372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.583375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.583737 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.584067 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.584865 (+ 798us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.585186 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:57:11.589363 9905 raft_consensus.cc:348] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.589735 9905 raft_consensus.cc:374] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:11.589886 9905 raft_consensus.cc:729] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad32e90f1ce49aba82c3e2610ea3167, State: Initialized, Role: FOLLOWER
I20260811 18:57:11.590539 9905 consensus_queue.cc:260] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.594188 9905 sys_catalog.cc:564] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:11.603381 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.577082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.19.155.252:35565)
0811 18:57:11.577249 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.577255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.583988 (+ 6733us) server_negotiation.cc:407] Connection header received
0811 18:57:11.584405 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.584410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.584510 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.584581 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.586296 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.587411 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.589387 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.590347 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.590527 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.594071 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.594077 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.594082 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.594122 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.598457 (+ 4335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.599560 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.599568 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.599575 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.599777 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.600322 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.600330 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.600336 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.600828 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.601131 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.602505 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.602844 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:57:11.596330 10156 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.605971 10156 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.606781 10015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.565967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39758 (local address 127.19.155.253:34403)
0811 18:57:11.566164 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.566171 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.576997 (+ 10826us) server_negotiation.cc:407] Connection header received
0811 18:57:11.577460 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.577468 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.577599 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.577693 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.580169 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.581633 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.591076 (+ 9443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.592426 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.592567 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.597532 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.597542 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.597550 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.597609 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.602444 (+ 4835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.603653 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.603662 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.603668 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.603893 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.604467 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.604475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.604481 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.604986 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.605288 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.606023 (+ 735us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.606342 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:57:11.612569 10019 master_runner.cc:186] Error getting master registration for 127.19.155.254:38409: OK, instance_id { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" instance_seqno: 1786474630390384 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:11.626437 10019 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 18:57:11.629621 9835 tablet.cc:2369] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:57:11.630712 10181 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:11.630957 10181 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 18:57:11.633859 10195 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:11.634080 10195 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:11.625931 9799 master_runner.cc:186] Error getting master registration for 127.19.155.253:34403: OK, instance_id { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" instance_seqno: 1786474630919977 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:11.639685 9799 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:57:11.649267 10006 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } attempt: 5
Aug 11 18:57:11 dist-test-slave-1nl6 krb5kdc[9781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 18:57:11.668632 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.649989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:35565 (local address 127.0.0.1:55610)
0811 18:57:11.650512 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:11.650537 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:11.650651 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:11.651251 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:11.651258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:11.651805 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:11.652021 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.652035 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.654168 (+ 2133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.654174 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.655658 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:11.655674 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.656744 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.656751 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:11.656970 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.657693 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:11.657719 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:11.660648 (+ 2929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:11.665631 (+ 4983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.665638 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.665642 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.666157 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.666621 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:11.666628 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:11.666632 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:11.666835 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:11.667570 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:11.667576 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:11.667745 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 18:57:11.667905 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 18:57:11.668217 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349}
I20260811 18:57:11.668749 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.650362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.19.155.252:35565)
0811 18:57:11.650551 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.650558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.650588 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:57:11.650823 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.650831 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.650945 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.651042 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.652826 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.654002 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.655832 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:11.656568 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:11.656724 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:11.660868 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.660876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.660882 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:11.660922 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.665464 (+ 4542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.666296 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.666302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.666306 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.666481 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:11.667046 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:11.667053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:11.667059 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:11.667434 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.667627 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.668067 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.668332 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:57:11.675381 10006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: Bootstrap starting.
I20260811 18:57:11.680336 10006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:11.681735 10006 log.cc:824] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:11.685313 10006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: No bootstrap required, opened a new log
I20260811 18:57:11.696662 10006 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.697096 10006 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:11.697222 10006 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8e28f731c3c4c888fd833a7ab24898d, State: Initialized, Role: FOLLOWER
I20260811 18:57:11.697871 10006 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.698927 10198 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
W20260811 18:57:11.699257 10049 tablet.cc:2369] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:11.699532 10198 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.701333 10006 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:11.727085 9913 master_runner.cc:263] No leader master found from master f8e28f731c3c4c888fd833a7ab24898d
I20260811 18:57:11.727253 9913 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 18:57:11.730008 10217 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:11.730237 10217 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:11.743167 10156 raft_consensus.cc:482] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:11.743486 10156 raft_consensus.cc:504] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.745129 10156 leader_election.cc:288] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8e28f731c3c4c888fd833a7ab24898d (127.19.155.253:34403), f388c4a1c7a0435f989b31d948bbb866 (127.19.155.252:35565)
I20260811 18:57:11.746371 9972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad32e90f1ce49aba82c3e2610ea3167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e28f731c3c4c888fd833a7ab24898d" is_pre_election: true
I20260811 18:57:11.747004 9972 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad32e90f1ce49aba82c3e2610ea3167 in term 0.
I20260811 18:57:11.748103 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad32e90f1ce49aba82c3e2610ea3167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f388c4a1c7a0435f989b31d948bbb866" is_pre_election: true
I20260811 18:57:11.748694 10083 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad32e90f1ce49aba82c3e2610ea3167 in term 0.
I20260811 18:57:11.749413 9822 leader_election.cc:302] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dad32e90f1ce49aba82c3e2610ea3167, f8e28f731c3c4c888fd833a7ab24898d; no voters:
I20260811 18:57:11.750401 10156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:11.750552 10156 raft_consensus.cc:482] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:11.750648 10156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:11.758018 10156 raft_consensus.cc:504] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.761062 9972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad32e90f1ce49aba82c3e2610ea3167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e28f731c3c4c888fd833a7ab24898d"
I20260811 18:57:11.761307 9972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:11.764863 9972 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad32e90f1ce49aba82c3e2610ea3167 in term 1.
I20260811 18:57:11.765612 9822 leader_election.cc:302] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dad32e90f1ce49aba82c3e2610ea3167, f8e28f731c3c4c888fd833a7ab24898d; no voters:
I20260811 18:57:11.767956 10156 leader_election.cc:288] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [CANDIDATE]: Term 1 election: Requested vote from peers f8e28f731c3c4c888fd833a7ab24898d (127.19.155.253:34403), f388c4a1c7a0435f989b31d948bbb866 (127.19.155.252:35565)
I20260811 18:57:11.768479 10156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:11.768879 10156 raft_consensus.cc:686] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [term 1 LEADER]: Becoming Leader. State: Replica: dad32e90f1ce49aba82c3e2610ea3167, State: Running, Role: LEADER
I20260811 18:57:11.769698 10156 consensus_queue.cc:237] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } }
I20260811 18:57:11.783783 10083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dad32e90f1ce49aba82c3e2610ea3167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f388c4a1c7a0435f989b31d948bbb866"
I20260811 18:57:11.784054 10083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:11.788055 10083 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad32e90f1ce49aba82c3e2610ea3167 in term 1.
I20260811 18:57:11.793283 10221 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad32e90f1ce49aba82c3e2610ea3167. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.793805 10221 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:11.801486 10225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:11.804154 10225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:11.824748 10083 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [term 1 FOLLOWER]: Refusing update from remote peer dad32e90f1ce49aba82c3e2610ea3167: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:11.825873 10221 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:11.836331 9972 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [term 1 FOLLOWER]: Refusing update from remote peer dad32e90f1ce49aba82c3e2610ea3167: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:11.837327 10221 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:11.864283 10198 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad32e90f1ce49aba82c3e2610ea3167. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.864643 10198 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.867780 10227 mvcc.cc:205] Tried to move back new op lower bound from 7317400091941019648 to 7317400091741618176. Current Snapshot: MvccSnapshot[applied={T|T < 7317400091941019648}]
I20260811 18:57:11.874094 10229 mvcc.cc:205] Tried to move back new op lower bound from 7317400091941019648 to 7317400091741618176. Current Snapshot: MvccSnapshot[applied={T|T < 7317400091941019648}]
I20260811 18:57:11.878669 10156 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.879025 10156 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:11.880692 10225 catalog_manager.cc:1347] Generated new cluster ID: bb205913d47e41e3b62a89e6802e9e89
I20260811 18:57:11.880786 10225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:11.895351 10198 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.895633 10198 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.903564 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dad32e90f1ce49aba82c3e2610ea3167. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.903857 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.910387 10221 sys_catalog.cc:455] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.910669 10221 sys_catalog.cc:458] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:11.912340 10228 mvcc.cc:205] Tried to move back new op lower bound from 7317400091941019648 to 7317400091741618176. Current Snapshot: MvccSnapshot[applied={T|T < 7317400091941019648}]
I20260811 18:57:11.927750 10149 sys_catalog.cc:455] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad32e90f1ce49aba82c3e2610ea3167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad32e90f1ce49aba82c3e2610ea3167" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38409 } } peers { permanent_uuid: "f8e28f731c3c4c888fd833a7ab24898d" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 34403 } } peers { permanent_uuid: "f388c4a1c7a0435f989b31d948bbb866" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 35565 } } }
I20260811 18:57:11.928009 10149 sys_catalog.cc:458] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:11.937271 10225 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:11.939222 10225 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:11.969861 10225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dad32e90f1ce49aba82c3e2610ea3167: Generated new TSK 0
I20260811 18:57:11.971004 10225 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:12.633137 10181 catalog_manager.cc:1259] Loaded cluster ID: bb205913d47e41e3b62a89e6802e9e89
I20260811 18:57:12.633275 10181 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: loading cluster ID for follower catalog manager: success
I20260811 18:57:12.635921 10181 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: acquiring CA information for follower catalog manager: success
I20260811 18:57:12.637666 10181 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f388c4a1c7a0435f989b31d948bbb866: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:57:12.733209 10217 catalog_manager.cc:1259] Loaded cluster ID: bb205913d47e41e3b62a89e6802e9e89
I20260811 18:57:12.733357 10217 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: loading cluster ID for follower catalog manager: success
I20260811 18:57:12.737349 10217 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: acquiring CA information for follower catalog manager: success
I20260811 18:57:12.739959 10217 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f8e28f731c3c4c888fd833a7ab24898d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:57:13.103349 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 9799
I20260811 18:57:13.104697 9897 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:13.217448 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 9799
I20260811 18:57:13.252456 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 9913
I20260811 18:57:13.253733 10001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:13.374202 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 9913
I20260811 18:57:13.408205 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 10019
I20260811 18:57:13.409353 10119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:13.515138 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 10019
2026-08-11T18:57:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5191 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:13 dist-test-slave-1nl6 krb5kdc[10250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:13 dist-test-slave-1nl6 krb5kdc[10250](info): set up 2 sockets
Aug 11 18:57:13 dist-test-slave-1nl6 krb5kdc[10250](info): commencing operation
krb5kdc: starting...
W20260811 18:57:14.867652 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:57:15.151839 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:43739
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:44825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:43739
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:15.496165 10268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:15.496538 10268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:15.496709 10268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:15.504065 10268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:15.504243 10268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:15.504360 10268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:15.504467 10268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:15.504557 10268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:15.514672 10268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:44825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:43739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:43739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:15.516122 10268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:15.517470 10268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:15.529404 10278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:15.529475 10281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:15.529475 10279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:15.530694 10268 server_base.cc:1034] running on GCE node
I20260811 18:57:15.531589 10268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:15.533140 10268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:15.534391 10268 hybrid_clock.cc:648] HybridClock initialized: now 1786474635534339 us; error 59 us; skew 500 ppm
I20260811 18:57:15.534772 10268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474635, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:15.542868 10268 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:15.544519 10268 webserver.cc:460] Webserver started at http://127.19.155.254:46421/ using document root <none> and password file <none>
I20260811 18:57:15.545222 10268 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:15.545339 10268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:15.545601 10268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:15.548817 10268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "83fbee5e1a6f488fadde453cd95aad9f"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-1nl6"
server_key: "4b52c215a4cc844ba5fa1071a7835476"
server_key_iv: "1a197d1173fa9d2c82fc009032b750c6"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.549558 10268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "83fbee5e1a6f488fadde453cd95aad9f"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-1nl6"
server_key: "4b52c215a4cc844ba5fa1071a7835476"
server_key_iv: "1a197d1173fa9d2c82fc009032b750c6"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.554878 10268 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:57:15.558409 10290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:15.559827 10268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:57:15.560029 10268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "83fbee5e1a6f488fadde453cd95aad9f"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-1nl6"
server_key: "4b52c215a4cc844ba5fa1071a7835476"
server_key_iv: "1a197d1173fa9d2c82fc009032b750c6"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.560240 10268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:15.592392 10268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:15.596976 10268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:15.597306 10268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:15.617277 10268 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:43739
I20260811 18:57:15.617298 10379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:43739 every 8 connection(s)
I20260811 18:57:15.618738 10268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:15.620327 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 10268
I20260811 18:57:15.620570 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:57:15.621428 20079 external_mini_cluster.cc:1428] Setting key 6178e83f8ee6ae618fd03a5b8da97e5c
I20260811 18:57:15.623885 10381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:15.638370 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f: Bootstrap starting.
I20260811 18:57:15.642151 10381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:15.643343 10381 log.cc:824] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:15.646549 10388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:15.623444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47788 (local address 127.19.155.254:43739)
0811 18:57:15.624384 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:15.624396 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:15.624438 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:15.626136 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:15.626158 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:15.626557 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:15.626889 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:15.628820 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:15.630414 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:15.632423 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:15.633103 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:15.633236 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:15.638452 (+ 5216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:15.638460 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:15.638476 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:15.638545 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:15.641918 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:15.642841 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:15.642849 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:15.642856 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:15.643102 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:15.643599 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:15.643609 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:15.643611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:15.644401 (+ 790us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:15.644755 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:15.645152 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 18:57:15.645525 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":474,"threads_started":1}
I20260811 18:57:15.646750 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f: No bootstrap required, opened a new log
I20260811 18:57:15.650413 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:15.655764 10381 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } }
I20260811 18:57:15.656100 10381 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:15.656185 10381 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83fbee5e1a6f488fadde453cd95aad9f, State: Initialized, Role: FOLLOWER
I20260811 18:57:15.656654 10381 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } }
I20260811 18:57:15.656857 10381 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:15.656951 10381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:15.657079 10381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:15.659170 10381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } }
I20260811 18:57:15.659613 10381 leader_election.cc:302] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83fbee5e1a6f488fadde453cd95aad9f; no voters:
I20260811 18:57:15.660166 10381 leader_election.cc:288] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:15.660336 10390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:15.661020 10390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [term 1 LEADER]: Becoming Leader. State: Replica: 83fbee5e1a6f488fadde453cd95aad9f, State: Running, Role: LEADER
I20260811 18:57:15.661609 10390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } }
I20260811 18:57:15.662279 10381 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:15.664938 10394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83fbee5e1a6f488fadde453cd95aad9f. Latest consensus state: current_term: 1 leader_uuid: "83fbee5e1a6f488fadde453cd95aad9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } } }
I20260811 18:57:15.665201 10391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83fbee5e1a6f488fadde453cd95aad9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fbee5e1a6f488fadde453cd95aad9f" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 43739 } } }
I20260811 18:57:15.665849 10394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:15.665845 10391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:15.667654 10398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:15.673390 10398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:15.683502 10398 catalog_manager.cc:1347] Generated new cluster ID: 04213935ea464e3984d7de49ecd339ce
I20260811 18:57:15.683600 10398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:15.691684 10398 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:15.692998 10398 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:15.705880 10398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83fbee5e1a6f488fadde453cd95aad9f: Generated new TSK 0
I20260811 18:57:15.706745 10398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:15.763904 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 10268
I20260811 18:57:15.765188 10374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:15.861670 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 10268
2026-08-11T18:57:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2345 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10423](info): set up 2 sockets
Aug 11 18:57:15 dist-test-slave-1nl6 krb5kdc[10423](info): commencing operation
krb5kdc: starting...
W20260811 18:57:17.228497 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:57:17 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:57:17.502733 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:17.838936 10441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:17.839257 10441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:17.839454 10441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:17.846498 10441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:17.846601 10441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:17.846709 10441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:17.846807 10441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:17.846894 10441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:17.856686 10441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:17.858055 10441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:17.859397 10441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:17.871456 10452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:17.871560 10458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:17.871598 10450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:17.872537 10441 server_base.cc:1034] running on GCE node
I20260811 18:57:17.873370 10441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:17.874684 10441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:17.875911 10441 hybrid_clock.cc:648] HybridClock initialized: now 1786474637875835 us; error 68 us; skew 500 ppm
I20260811 18:57:17.876294 10441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:17 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:17.879530 10441 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:17.880896 10441 webserver.cc:460] Webserver started at http://127.19.155.254:41817/ using document root <none> and password file <none>
I20260811 18:57:17.881539 10441 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:17.881642 10441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:17.881876 10441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:17.884838 10441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "c053c169cd4044daa15b08daba703f81"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-1nl6"
server_key: "f1b6aa222269232b4b2f35b4d96792f7"
server_key_iv: "22435c0d88bcbfcdab37919f96abcc06"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.885553 10441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "c053c169cd4044daa15b08daba703f81"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-1nl6"
server_key: "f1b6aa222269232b4b2f35b4d96792f7"
server_key_iv: "22435c0d88bcbfcdab37919f96abcc06"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.891003 10441 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:57:17.894218 10467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:17.895555 10441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:17.895733 10441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "c053c169cd4044daa15b08daba703f81"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-1nl6"
server_key: "f1b6aa222269232b4b2f35b4d96792f7"
server_key_iv: "22435c0d88bcbfcdab37919f96abcc06"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.895924 10441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:17.912601 10441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:17.916965 10441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:17.917266 10441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:17.936092 10441 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46087
I20260811 18:57:17.936132 10549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46087 every 8 connection(s)
I20260811 18:57:17.937382 10441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:17.939556 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 10441
I20260811 18:57:17.939780 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:57:17.940682 20079 external_mini_cluster.cc:1428] Setting key db9c80080843090161051f9ef34db8dd
I20260811 18:57:17.941954 10553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:57:17 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:17.956422 10553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap starting.
I20260811 18:57:17.960673 10553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:17.961966 10553 log.cc:824] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:17.965080 10558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:17.942750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40670 (local address 127.19.155.254:46087)
0811 18:57:17.943610 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:17.943621 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:17.943659 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:57:17.945151 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:17.945171 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:17.945533 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:17.945845 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:17.947732 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.949038 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.950943 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.951577 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.951699 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:17.956562 (+ 4863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:17.956574 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:17.956591 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:17.956638 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:17.960520 (+ 3882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.961256 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.961264 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.961272 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.961476 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.961834 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.961838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.961842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.962560 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:17.962846 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:17.963387 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 18:57:17.963818 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":433,"threads_started":1}
I20260811 18:57:17.965373 10553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: No bootstrap required, opened a new log
I20260811 18:57:17.972488 10553 raft_consensus.cc:348] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:17.972863 10553 raft_consensus.cc:374] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:17.972982 10553 raft_consensus.cc:729] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c053c169cd4044daa15b08daba703f81, State: Initialized, Role: FOLLOWER
I20260811 18:57:17.973618 10553 consensus_queue.cc:260] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:17.973896 10553 raft_consensus.cc:388] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:17.974084 10553 raft_consensus.cc:482] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:17.974290 10553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:17.976451 10553 raft_consensus.cc:504] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:17.976936 10553 leader_election.cc:302] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c053c169cd4044daa15b08daba703f81; no voters:
I20260811 18:57:17.977556 10553 leader_election.cc:288] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:17.977715 10560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:17.978950 10560 raft_consensus.cc:686] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 LEADER]: Becoming Leader. State: Replica: c053c169cd4044daa15b08daba703f81, State: Running, Role: LEADER
I20260811 18:57:17.979457 10560 consensus_queue.cc:237] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:17.979866 10553 sys_catalog.cc:564] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:17.982502 10563 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c053c169cd4044daa15b08daba703f81. Latest consensus state: current_term: 1 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:17.982640 10562 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:17.983299 10562 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:17.983302 10563 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:17.985381 10574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:17.990269 10574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:17.998421 10574 catalog_manager.cc:1347] Generated new cluster ID: 241b50d521ba44f7a3d5a08a5fe3664b
I20260811 18:57:17.998528 10574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:18.008950 10574 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:18.010844 10574 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:18.022091 10574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Generated new TSK 0
I20260811 18:57:18.023159 10574 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:57:18.087762 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:18.428592 10592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:18.428877 10592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:18.429055 10592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:18.436296 10592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:18.436409 10592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:18.436614 10592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:18.446274 10592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:18.447539 10592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:18.448899 10592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:18.461886 10600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.461920 10603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.461851 10601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:18.462872 10592 server_base.cc:1034] running on GCE node
I20260811 18:57:18.463604 10592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:18.464715 10592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:18.465969 10592 hybrid_clock.cc:648] HybridClock initialized: now 1786474638465913 us; error 57 us; skew 500 ppm
I20260811 18:57:18.466337 10592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:18 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:18.470413 10592 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:18.471868 10592 webserver.cc:460] Webserver started at http://127.19.155.193:33431/ using document root <none> and password file <none>
I20260811 18:57:18.472517 10592 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:18.472623 10592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:18.472877 10592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:18.475769 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "79af813e27d647fba7ad22f458d63c63"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "16bb7fb108b18c7f17799b4a99095b07"
server_key_iv: "38e2f8c3b8ff4121211c91b426f74705"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.476508 10592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "79af813e27d647fba7ad22f458d63c63"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "16bb7fb108b18c7f17799b4a99095b07"
server_key_iv: "38e2f8c3b8ff4121211c91b426f74705"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.481631 10592 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:57:18.485245 10619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:18.486606 10592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:57:18.486781 10592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "79af813e27d647fba7ad22f458d63c63"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "16bb7fb108b18c7f17799b4a99095b07"
server_key_iv: "38e2f8c3b8ff4121211c91b426f74705"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.487033 10592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:18.502538 10592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:18.506431 10592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:18.506727 10592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:18.507687 10592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:18.509099 10592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:18.509238 10592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:18.509384 10592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:18.509469 10592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:18.541000 10592 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35821
I20260811 18:57:18.541038 10803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35821 every 8 connection(s)
I20260811 18:57:18.542289 10592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:18.552459 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 10592
I20260811 18:57:18.552711 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:18.553432 20079 external_mini_cluster.cc:1428] Setting key 3c91559b229ba6553d53b160b323712d
Aug 11 18:57:18 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:18.563195 10808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:18.544782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:46159 (local address 127.19.155.254:46087)
0811 18:57:18.545241 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:18.545246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:18.546061 (+ 815us) server_negotiation.cc:407] Connection header received
0811 18:57:18.547810 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:18.547815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:18.547912 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:18.548032 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:18.549511 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.550228 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.551804 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.552444 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.552606 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:18.556909 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:18.556915 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:18.556919 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:18.556951 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:18.559685 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:18.560666 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:18.560670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:18.560673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:18.560796 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:18.561325 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:18.561329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:18.561331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:18.561613 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:18.561725 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:18.562659 (+ 934us) server_negotiation.cc:299] Negotiation successful
0811 18:57:18.562843 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":259,"threads_started":1}
I20260811 18:57:18.564577 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:18.545230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:46159)
0811 18:57:18.545896 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:18.545941 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:18.547544 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:18.548268 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:18.548276 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:18.548763 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:18.549317 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:18.549335 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.550416 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.550420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:18.551638 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:18.551651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.552750 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.552775 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:18.553013 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:18.553771 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:18.553803 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:18.556673 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:18.559866 (+ 3193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:18.559878 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:18.559895 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:18.560520 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:18.560913 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:18.560920 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:18.560926 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:18.561196 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:18.561746 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:18.561756 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:18.562221 (+ 465us) client_negotiation.cc:769] Sending connection context
0811 18:57:18.562533 (+ 312us) client_negotiation.cc:240] Negotiation successful
0811 18:57:18.563175 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":249,"threads_started":1}
I20260811 18:57:18.566160 10804 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:18.566474 10804 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:18.567276 10804 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:18.569372 10495 ts_manager.cc:194] Registered new tserver with Master: 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821)
I20260811 18:57:18.570842 10495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:46159
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:57:18.614683 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:18.955608 10815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:18.955902 10815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:18.956069 10815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:18.963217 10815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:18.963373 10815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:18.963542 10815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:18.973218 10815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:18.974529 10815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:18.975937 10815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:18.989959 10825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.990028 10828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.989998 10826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:18.990741 10815 server_base.cc:1034] running on GCE node
I20260811 18:57:18.991470 10815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:18.992434 10815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:18.993664 10815 hybrid_clock.cc:648] HybridClock initialized: now 1786474638993617 us; error 57 us; skew 500 ppm
I20260811 18:57:18.993994 10815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:18 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:18.997031 10815 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:18.998514 10815 webserver.cc:460] Webserver started at http://127.19.155.194:39855/ using document root <none> and password file <none>
I20260811 18:57:18.999286 10815 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:18.999446 10815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:18.999768 10815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:19.002604 10815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "3e70351991104d24b5ecb81651c7f186"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "6bf90ee7366082edc8eaa7ae92d4f4f8"
server_key_iv: "e521119c879b88a7d0b491e0fc69091b"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.003437 10815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "3e70351991104d24b5ecb81651c7f186"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "6bf90ee7366082edc8eaa7ae92d4f4f8"
server_key_iv: "e521119c879b88a7d0b491e0fc69091b"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.008529 10815 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:57:19.011952 10843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.013255 10815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:19.013443 10815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "3e70351991104d24b5ecb81651c7f186"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "6bf90ee7366082edc8eaa7ae92d4f4f8"
server_key_iv: "e521119c879b88a7d0b491e0fc69091b"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.013635 10815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:19.037519 10815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:19.041575 10815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:19.041879 10815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:19.043013 10815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:19.044436 10815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:19.044543 10815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.044699 10815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:19.044775 10815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.078316 10815 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39347
I20260811 18:57:19.078388 11016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39347 every 8 connection(s)
I20260811 18:57:19.079648 10815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:19.083778 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 10815
I20260811 18:57:19.083974 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:19.084582 20079 external_mini_cluster.cc:1428] Setting key 41d324cd1c4aa8c7e2c08d84b8feded2
Aug 11 18:57:19 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:19.102499 11019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.082165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:39817 (local address 127.19.155.254:46087)
0811 18:57:19.082637 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.082642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.083647 (+ 1005us) server_negotiation.cc:407] Connection header received
0811 18:57:19.086112 (+ 2465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.086118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.086220 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.086337 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:19.088428 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.089151 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.091704 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.092205 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.092300 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.096571 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:19.096576 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:19.096580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:19.096613 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:19.099295 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.100058 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.100065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.100073 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.100201 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.100724 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.100734 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.100737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.101002 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:19.101165 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.101875 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.102105 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":240,"threads_started":1}
I20260811 18:57:19.103518 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.082611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:39817)
0811 18:57:19.083446 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.083507 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.085838 (+ 2331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.086588 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.086601 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.087391 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:19.088239 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.088268 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.089323 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.089332 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.091544 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.091563 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.092441 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.092451 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.092789 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.093577 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:19.093615 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:19.096336 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:19.099448 (+ 3112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:19.099457 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:19.099475 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:19.099923 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:19.100361 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:19.100366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:19.100370 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:19.100592 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:19.101135 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:19.101143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:19.101497 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.101762 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.102307 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":345,"threads_started":1}
I20260811 18:57:19.105226 11017 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:19.105571 11017 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:19.106349 11017 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:19.108043 10495 ts_manager.cc:194] Registered new tserver with Master: 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347)
I20260811 18:57:19.108958 10495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:39817
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:57:19.153592 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:19.497465 11024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:19.497735 11024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:19.497826 11024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:19.505503 11024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:19.505618 11024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:19.505787 11024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:19.515621 11024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:19.516995 11024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:19.518463 11024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:19.532047 11033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:19.532161 11038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:19.532271 11034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:19.533178 11024 server_base.cc:1034] running on GCE node
I20260811 18:57:19.533756 11024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:19.534672 11024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:19.535874 11024 hybrid_clock.cc:648] HybridClock initialized: now 1786474639535798 us; error 59 us; skew 500 ppm
I20260811 18:57:19.536149 11024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:19 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:19.539266 11024 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:19.540738 11024 webserver.cc:460] Webserver started at http://127.19.155.195:37007/ using document root <none> and password file <none>
I20260811 18:57:19.541414 11024 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:19.541548 11024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:19.541863 11024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:19.544708 11024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "83f880db6808457f8e6ddcb601fb386c"
format_stamp: "Formatted at 2026-08-11 18:57:19 on dist-test-slave-1nl6"
server_key: "46834cce4f51231213cd699debf9c823"
server_key_iv: "8ea02ee55c46321071dcdec611fa0bf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.545476 11024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "83f880db6808457f8e6ddcb601fb386c"
format_stamp: "Formatted at 2026-08-11 18:57:19 on dist-test-slave-1nl6"
server_key: "46834cce4f51231213cd699debf9c823"
server_key_iv: "8ea02ee55c46321071dcdec611fa0bf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.550427 11024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:57:19.553747 11047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.555078 11024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:19.555248 11024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "83f880db6808457f8e6ddcb601fb386c"
format_stamp: "Formatted at 2026-08-11 18:57:19 on dist-test-slave-1nl6"
server_key: "46834cce4f51231213cd699debf9c823"
server_key_iv: "8ea02ee55c46321071dcdec611fa0bf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:19.555431 11024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:19.573645 10804 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:19.586228 11024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:19.590229 11024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:19.590520 11024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:19.591650 11024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:19.593019 11024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:19.593120 11024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.593259 11024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:19.593338 11024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:19.625669 11024 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:46013
I20260811 18:57:19.625710 11225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:46013 every 8 connection(s)
I20260811 18:57:19.626991 11024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:19.633406 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 11024
I20260811 18:57:19.633610 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:19.634055 20079 external_mini_cluster.cc:1428] Setting key 6ca966e4657b093839e743b7c1d3e209
Aug 11 18:57:19 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:19.646765 11228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.629661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:59191 (local address 127.19.155.254:46087)
0811 18:57:19.630145 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.630150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.631178 (+ 1028us) server_negotiation.cc:407] Connection header received
0811 18:57:19.632912 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.632917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.633049 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.633179 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:19.634890 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.635863 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.637809 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.638184 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.638285 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.641512 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:19.641517 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:19.641521 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:19.641554 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:19.644214 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.644853 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.644856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.644859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.644990 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.645358 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.645361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.645363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.645609 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:19.645725 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.646313 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.646474 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":238,"threads_started":1}
I20260811 18:57:19.647727 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.630242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:59191)
0811 18:57:19.630995 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.631052 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.632655 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.633382 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.633389 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.634000 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:19.634686 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.634711 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.636045 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.636055 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.637680 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.637692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.638371 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.638375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.638567 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.639197 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:19.639219 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:19.641318 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:19.644354 (+ 3036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:19.644360 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:19.644371 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:19.644754 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:19.645084 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:19.645087 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:19.645089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:19.645266 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:19.645712 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:19.645718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:19.646011 (+ 293us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.646230 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.646582 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":275,"threads_started":1}
I20260811 18:57:19.649338 11226 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:19.649703 11226 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:19.650477 11226 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:19.651923 10495 ts_manager.cc:194] Registered new tserver with Master: 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013)
I20260811 18:57:19.652714 10495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:59191
I20260811 18:57:19.661873 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:19.678546 11228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.666226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40680 (local address 127.19.155.254:46087)
0811 18:57:19.666393 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.666397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.666862 (+ 465us) server_negotiation.cc:407] Connection header received
0811 18:57:19.667060 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.667063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.667118 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.667193 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:19.668543 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.669459 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.670739 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.671208 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.671303 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.673691 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:19.673695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:19.673699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:19.673728 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:19.676245 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.676943 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.676947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.676949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.677071 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.677402 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.677405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.677407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.677701 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:19.677866 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.678161 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.678317 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:57:19.682420 10495 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:19.689795 10495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:19.726596 11246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.702604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:46013 (local address 127.0.0.1:56476)
0811 18:57:19.716421 (+ 13817us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.716462 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.716658 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.719200 (+ 2542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.719204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.719232 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:19.720163 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.720179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.722117 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.722124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.724002 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.724019 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.725569 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.725575 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.725774 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.725851 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.725977 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.726170 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13557,"mutex_wait_us":31,"thread_start_us":13408,"threads_started":1}
I20260811 18:57:19.727155 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.702956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56476 (local address 127.19.155.195:46013)
0811 18:57:19.718603 (+ 15647us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.718614 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.718647 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:57:19.718749 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.718757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.719003 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.719213 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:19.720413 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.721990 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.724186 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.725327 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.725574 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.726549 (+ 975us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.726633 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.726802 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15460,"thread_start_us":15294,"threads_started":1}
I20260811 18:57:19.727317 11251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.702773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35821 (local address 127.0.0.1:52042)
0811 18:57:19.717747 (+ 14974us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.717765 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.717975 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.718768 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.718780 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.718828 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:19.719716 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.719737 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.721593 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.721599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.724342 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.724357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.726485 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.726493 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.726671 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.726705 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.726782 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.726914 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14850,"mutex_wait_us":308,"thread_start_us":16890,"threads_started":1}
I20260811 18:57:19.728108 11250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.703397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52042 (local address 127.19.155.193:35821)
0811 18:57:19.715592 (+ 12195us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.715607 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.717872 (+ 2265us) server_negotiation.cc:407] Connection header received
0811 18:57:19.718170 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.718181 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.718472 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.718689 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:19.720044 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.721455 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.724524 (+ 3069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.725960 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.726149 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.726314 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.727619 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.727780 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11938,"thread_start_us":12203,"threads_started":1}
I20260811 18:57:19.728713 11247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.705192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:39347 (local address 127.0.0.1:46000)
0811 18:57:19.719970 (+ 14778us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.719988 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.720187 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.721095 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.721100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.721124 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:19.721484 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.721497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.723356 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.723361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.725563 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.725579 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.727910 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.727917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.728076 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.728117 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.728215 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.728333 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14661,"mutex_wait_us":18,"thread_start_us":12241,"threads_started":1}
I20260811 18:57:19.729471 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.705824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46000 (local address 127.19.155.194:39347)
0811 18:57:19.717264 (+ 11440us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.717273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.720082 (+ 2809us) server_negotiation.cc:407] Connection header received
0811 18:57:19.720404 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.720411 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.720631 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.720797 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:19.721687 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.723204 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.725762 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.727441 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.727616 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.727760 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.728971 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.729142 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11268,"thread_start_us":11234,"threads_started":1}
I20260811 18:57:19.731226 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 45ab2af5780745d4a917a067758df29f (DEFAULT_TABLE table=test-table [id=ec0053f361eb44568468ff3a79d832d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:19.732772 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ab2af5780745d4a917a067758df29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:19.732558 10918 tablet_service.cc:1467] Processing CreateTablet for tablet 45ab2af5780745d4a917a067758df29f (DEFAULT_TABLE table=test-table [id=ec0053f361eb44568468ff3a79d832d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:19.733985 10918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ab2af5780745d4a917a067758df29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:19.734531 10697 tablet_service.cc:1467] Processing CreateTablet for tablet 45ab2af5780745d4a917a067758df29f (DEFAULT_TABLE table=test-table [id=ec0053f361eb44568468ff3a79d832d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:19.735948 10697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ab2af5780745d4a917a067758df29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:19.744165 11259 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Bootstrap starting.
I20260811 18:57:19.747974 11259 tablet_bootstrap.cc:654] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:19.748826 11260 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Bootstrap starting.
I20260811 18:57:19.749344 11259 log.cc:824] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:19.750784 11261 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Bootstrap starting.
I20260811 18:57:19.752404 11259 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: No bootstrap required, opened a new log
I20260811 18:57:19.752681 11259 ts_tablet_manager.cc:1397] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 18:57:19.752763 11260 tablet_bootstrap.cc:654] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:19.754046 11260 log.cc:824] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:19.754379 11261 tablet_bootstrap.cc:654] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:19.755628 11261 log.cc:824] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:19.757050 11260 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: No bootstrap required, opened a new log
I20260811 18:57:19.757318 11260 ts_tablet_manager.cc:1397] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 18:57:19.758582 11261 tablet_bootstrap.cc:492] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: No bootstrap required, opened a new log
I20260811 18:57:19.758845 11261 ts_tablet_manager.cc:1397] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 18:57:19.761057 11259 raft_consensus.cc:348] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.761642 11259 raft_consensus.cc:374] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:19.761796 11259 raft_consensus.cc:729] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f880db6808457f8e6ddcb601fb386c, State: Initialized, Role: FOLLOWER
I20260811 18:57:19.762502 11259 consensus_queue.cc:260] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.763672 11226 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:19.764175 11259 ts_tablet_manager.cc:1428] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260811 18:57:19.769266 11261 raft_consensus.cc:348] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.769266 11260 raft_consensus.cc:348] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.769690 11261 raft_consensus.cc:374] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:19.769695 11260 raft_consensus.cc:374] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:19.769797 11260 raft_consensus.cc:729] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e70351991104d24b5ecb81651c7f186, State: Initialized, Role: FOLLOWER
I20260811 18:57:19.769802 11261 raft_consensus.cc:729] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79af813e27d647fba7ad22f458d63c63, State: Initialized, Role: FOLLOWER
I20260811 18:57:19.770430 11260 consensus_queue.cc:260] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.770430 11261 consensus_queue.cc:260] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.771617 11017 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:19.772293 11261 ts_tablet_manager.cc:1428] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260811 18:57:19.772293 11260 ts_tablet_manager.cc:1428] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
W20260811 18:57:19.794620 10806 tablet.cc:2369] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:19.831132 11269 raft_consensus.cc:482] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 18:57:19.831614 11018 tablet.cc:2369] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:19.831487 11269 raft_consensus.cc:504] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.833415 11269 leader_election.cc:288] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013), 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347)
I20260811 18:57:19.842482 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.833817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:52235 (local address 127.19.155.195:46013)
0811 18:57:19.834029 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.834035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.835080 (+ 1045us) server_negotiation.cc:407] Connection header received
0811 18:57:19.835190 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.835196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.835269 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.835359 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:19.836031 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.837063 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.839887 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.841130 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.841287 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.841365 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.842090 (+ 725us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.842222 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:57:19.842482 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.833825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:53347 (local address 127.19.155.194:39347)
0811 18:57:19.834029 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.834035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.834771 (+ 736us) server_negotiation.cc:407] Connection header received
0811 18:57:19.835029 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.835052 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.835132 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.835216 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:19.835875 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.836962 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.839892 (+ 2930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.841123 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.841283 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.841358 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.842090 (+ 732us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.842220 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:57:19.842717 11272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.833906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:39347 (local address 127.19.155.193:53347)
0811 18:57:19.834665 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.834685 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.834853 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.835228 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.835231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.835245 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:19.835713 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.835730 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.837090 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.837094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.839713 (+ 2619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.839727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.841553 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.841560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.841871 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.841946 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.842049 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.842218 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":234,"thread_start_us":684,"threads_started":1}
I20260811 18:57:19.842746 11271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.833915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:46013 (local address 127.19.155.193:52235)
0811 18:57:19.834970 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:19.834991 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:19.835092 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:19.835397 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:19.835401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:19.835425 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:19.835857 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.835870 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.837202 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.837210 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.839704 (+ 2494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:19.839727 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.841557 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.841562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:19.841875 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.841942 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 18:57:19.842049 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 18:57:19.842218 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"mutex_wait_us":261,"thread_start_us":320,"threads_started":1}
I20260811 18:57:19.843915 10947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ab2af5780745d4a917a067758df29f" candidate_uuid: "79af813e27d647fba7ad22f458d63c63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e70351991104d24b5ecb81651c7f186" is_pre_election: true
I20260811 18:57:19.844040 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ab2af5780745d4a917a067758df29f" candidate_uuid: "79af813e27d647fba7ad22f458d63c63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f880db6808457f8e6ddcb601fb386c" is_pre_election: true
I20260811 18:57:19.844473 10947 raft_consensus.cc:2454] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79af813e27d647fba7ad22f458d63c63 in term 0.
I20260811 18:57:19.844596 11153 raft_consensus.cc:2454] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79af813e27d647fba7ad22f458d63c63 in term 0.
I20260811 18:57:19.845197 10620 leader_election.cc:302] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e70351991104d24b5ecb81651c7f186, 79af813e27d647fba7ad22f458d63c63; no voters:
I20260811 18:57:19.845705 11269 raft_consensus.cc:2781] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:19.845887 11269 raft_consensus.cc:482] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:19.845999 11269 raft_consensus.cc:3037] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:19.848295 11269 raft_consensus.cc:504] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.848915 11269 leader_election.cc:288] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [CANDIDATE]: Term 1 election: Requested vote from peers 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013), 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347)
I20260811 18:57:19.849359 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ab2af5780745d4a917a067758df29f" candidate_uuid: "79af813e27d647fba7ad22f458d63c63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f880db6808457f8e6ddcb601fb386c"
I20260811 18:57:19.849423 10947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ab2af5780745d4a917a067758df29f" candidate_uuid: "79af813e27d647fba7ad22f458d63c63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e70351991104d24b5ecb81651c7f186"
I20260811 18:57:19.849586 11153 raft_consensus.cc:3037] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:19.849606 10947 raft_consensus.cc:3037] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:19.852902 10947 raft_consensus.cc:2454] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79af813e27d647fba7ad22f458d63c63 in term 1.
I20260811 18:57:19.852902 11153 raft_consensus.cc:2454] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79af813e27d647fba7ad22f458d63c63 in term 1.
I20260811 18:57:19.853386 10622 leader_election.cc:302] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e70351991104d24b5ecb81651c7f186, 79af813e27d647fba7ad22f458d63c63, 83f880db6808457f8e6ddcb601fb386c; no voters:
I20260811 18:57:19.853698 11269 raft_consensus.cc:2781] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:19.854120 11269 raft_consensus.cc:686] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 1 LEADER]: Becoming Leader. State: Replica: 79af813e27d647fba7ad22f458d63c63, State: Running, Role: LEADER
I20260811 18:57:19.854568 11269 consensus_queue.cc:237] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:19.859462 10495 catalog_manager.cc:5495] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79af813e27d647fba7ad22f458d63c63 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "79af813e27d647fba7ad22f458d63c63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } health_report { overall_health: UNKNOWN } } }
W20260811 18:57:19.878664 11227 tablet.cc:2369] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:19.887991 11250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.882726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52046 (local address 127.19.155.193:35821)
0811 18:57:19.882947 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.882953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.882976 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:57:19.883097 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.883100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.883190 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.883300 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:19.883643 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.884353 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.885836 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.886239 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.886326 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.886795 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:19.887420 (+ 625us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:19.887526 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.887639 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.887701 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:57:19.896098 10947 raft_consensus.cc:1261] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Refusing update from remote peer 79af813e27d647fba7ad22f458d63c63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:19.896154 11153 raft_consensus.cc:1261] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Refusing update from remote peer 79af813e27d647fba7ad22f458d63c63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:19.897118 11274 consensus_queue.cc:1035] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:19.897426 11269 consensus_queue.cc:1035] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:19.908144 11282 mvcc.cc:205] Tried to move back new op lower bound from 7317400125004783616 to 7317400124848103424. Current Snapshot: MvccSnapshot[applied={T|T < 7317400125004783616}]
I20260811 18:57:19.922741 10494 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:19.923095 10494 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:19.927089 10494 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Sending DeleteTablet for 3 replicas of tablet 45ab2af5780745d4a917a067758df29f
I20260811 18:57:19.928328 10697 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ab2af5780745d4a917a067758df29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:19 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:52042
I20260811 18:57:19.928443 10918 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ab2af5780745d4a917a067758df29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:19 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46000
I20260811 18:57:19.928349 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ab2af5780745d4a917a067758df29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:19 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:56476
I20260811 18:57:19.928742 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 10592
I20260811 18:57:19.941087 11295 tablet_replica.cc:330] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: stopping tablet replica
I20260811 18:57:19.942345 11295 raft_consensus.cc:2229] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:19.945813 11295 raft_consensus.cc:2258] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:19.947523 11299 tablet_replica.cc:330] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: stopping tablet replica
I20260811 18:57:19.948021 11299 raft_consensus.cc:2229] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:19.948678 11299 raft_consensus.cc:2258] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:19.949503 11298 tablet_replica.cc:330] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: stopping tablet replica
I20260811 18:57:19.949843 11298 raft_consensus.cc:2229] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:19.950300 11298 raft_consensus.cc:2258] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:19.952068 11299 ts_tablet_manager.cc:1905] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:19.952714 11295 ts_tablet_manager.cc:1905] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:19.959385 11299 ts_tablet_manager.cc:1918] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:19.959632 11299 log.cc:1196] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/45ab2af5780745d4a917a067758df29f
I20260811 18:57:19.959811 11298 ts_tablet_manager.cc:1905] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:19.960354 11299 ts_tablet_manager.cc:1939] T 45ab2af5780745d4a917a067758df29f P 83f880db6808457f8e6ddcb601fb386c: Deleting consensus metadata
I20260811 18:57:19.962217 10472 catalog_manager.cc:4841] TS 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013): tablet 45ab2af5780745d4a917a067758df29f (table test-table [id=ec0053f361eb44568468ff3a79d832d0]) successfully deleted
Aug 11 18:57:19 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:57:19.966471 11298 ts_tablet_manager.cc:1918] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:19.966513 11295 ts_tablet_manager.cc:1918] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:19.966710 11298 log.cc:1196] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/45ab2af5780745d4a917a067758df29f
I20260811 18:57:19.966782 11295 log.cc:1196] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/45ab2af5780745d4a917a067758df29f
I20260811 18:57:19.967381 11298 ts_tablet_manager.cc:1939] T 45ab2af5780745d4a917a067758df29f P 3e70351991104d24b5ecb81651c7f186: Deleting consensus metadata
I20260811 18:57:19.967465 11295 ts_tablet_manager.cc:1939] T 45ab2af5780745d4a917a067758df29f P 79af813e27d647fba7ad22f458d63c63: Deleting consensus metadata
I20260811 18:57:19.969154 10469 catalog_manager.cc:4841] TS 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347): tablet 45ab2af5780745d4a917a067758df29f (table test-table [id=ec0053f361eb44568468ff3a79d832d0]) successfully deleted
I20260811 18:57:19.969290 10474 catalog_manager.cc:4841] TS 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821): tablet 45ab2af5780745d4a917a067758df29f (table test-table [id=ec0053f361eb44568468ff3a79d832d0]) successfully deleted
I20260811 18:57:19.972699 11250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:19.930150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52054 (local address 127.19.155.193:35821)
0811 18:57:19.930377 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:19.930386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:19.940574 (+ 10188us) server_negotiation.cc:407] Connection header received
0811 18:57:19.942682 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:19.942687 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:19.942764 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:19.942842 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:19.948919 (+ 6077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.950031 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.959019 (+ 8988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:19.959702 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:19.959804 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:19.965410 (+ 5606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:19.965423 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:19.965441 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:19.965482 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:19.969666 (+ 4184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.970397 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.970404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.970406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.970556 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:19.971067 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:19.971077 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:19.971079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:19.971440 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:19.971738 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:19.972055 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 18:57:19.972356 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:57:19.973474 10794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:20.070544 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 10592
I20260811 18:57:20.098431 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 10815
Aug 11 18:57:20 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:57:20.113101 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:20.099157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46010 (local address 127.19.155.194:39347)
0811 18:57:20.099369 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:20.099374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:20.099417 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:57:20.099606 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:20.099610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:20.099674 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:20.099748 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:20.101148 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:20.101864 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:20.103138 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:20.103532 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:20.103626 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:20.107833 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:20.107852 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:20.107866 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:20.107894 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:20.110489 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:20.111273 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:20.111280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:20.111282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:20.111395 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:20.111707 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:20.111710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:20.111712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:20.112065 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:20.112307 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:20.112575 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 18:57:20.112729 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:57:20.113757 11010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:20.206892 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 10815
I20260811 18:57:20.231890 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 11024
Aug 11 18:57:20 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:57:20.247638 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:20.232728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.19.155.195:46013)
0811 18:57:20.232898 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:20.232903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:20.232923 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:57:20.233074 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:20.233078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:20.233145 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:20.233229 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:20.234606 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:20.235478 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:20.236727 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:20.237145 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:20.237246 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:20.241897 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:20.241913 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:20.241932 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:20.241975 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:20.244927 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:20.245599 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:20.245607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:20.245609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:20.245750 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:20.246122 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:20.246127 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:20.246131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:20.246515 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:20.246759 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:20.247087 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 18:57:20.247277 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:57:20.248328 11217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:20.337617 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 11024
I20260811 18:57:20.366832 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 10441
I20260811 18:57:20.368011 10545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:20.477823 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 10441
I20260811 18:57:20.509110 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--webserver_interface=127.19.155.254
--webserver_port=41817
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:20.857113 11311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:20.857471 11311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:20.857646 11311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:20.864928 11311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:20.865087 11311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:20.865187 11311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:20.865271 11311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:20.865356 11311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:20.875092 11311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=41817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:20.876381 11311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:20.877692 11311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:20.903580 11319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:20.903606 11325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:20.903645 11320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:20.904431 11311 server_base.cc:1034] running on GCE node
I20260811 18:57:20.905337 11311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:20.906993 11311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:20.908236 11311 hybrid_clock.cc:648] HybridClock initialized: now 1786474640908178 us; error 61 us; skew 500 ppm
I20260811 18:57:20.908699 11311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:20 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474640, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:20.916517 11311 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:20.918269 11311 webserver.cc:460] Webserver started at http://127.19.155.254:41817/ using document root <none> and password file <none>
I20260811 18:57:20.919147 11311 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:20.919327 11311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:20.925428 11311 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:57:20.928380 11335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:20.929757 11311 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:57:20.929973 11311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "c053c169cd4044daa15b08daba703f81"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-1nl6"
server_key: "f1b6aa222269232b4b2f35b4d96792f7"
server_key_iv: "22435c0d88bcbfcdab37919f96abcc06"
server_key_version: "encryptionkey@0"
I20260811 18:57:20.931182 11311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:20.955852 11311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:20.960106 11311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:20.960397 11311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:20.979853 11311 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46087
I20260811 18:57:20.979866 11413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46087 every 8 connection(s)
I20260811 18:57:20.981396 11311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:20.987762 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 11311
I20260811 18:57:20.988617 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:35821
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=33431
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:20.988675 11414 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:57:20.992344 11414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap starting.
I20260811 18:57:21.012072 11414 log.cc:824] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:21.024646 11414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:57:21.025202 11414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap complete.
I20260811 18:57:21.034511 11414 raft_consensus.cc:348] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:21.035554 11414 raft_consensus.cc:729] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c053c169cd4044daa15b08daba703f81, State: Initialized, Role: FOLLOWER
I20260811 18:57:21.036280 11414 consensus_queue.cc:260] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:21.036567 11414 raft_consensus.cc:388] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:21.036705 11414 raft_consensus.cc:482] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:21.036914 11414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:57:21.040774 11414 raft_consensus.cc:504] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:21.041319 11414 leader_election.cc:302] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c053c169cd4044daa15b08daba703f81; no voters:
I20260811 18:57:21.041989 11414 leader_election.cc:288] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:57:21.042136 11419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:57:21.043615 11419 raft_consensus.cc:686] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 LEADER]: Becoming Leader. State: Replica: c053c169cd4044daa15b08daba703f81, State: Running, Role: LEADER
I20260811 18:57:21.044260 11419 consensus_queue.cc:237] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:21.044523 11414 sys_catalog.cc:564] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:21.047353 11420 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:21.048614 11420 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:21.047212 11422 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c053c169cd4044daa15b08daba703f81. Latest consensus state: current_term: 2 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:21.051124 11422 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:21.062292 11436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:21.072435 11436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:21.074376 11436 catalog_manager.cc:1259] Loaded cluster ID: 241b50d521ba44f7a3d5a08a5fe3664b
I20260811 18:57:21.074577 11436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:21.078944 11436 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 18:57:21.105316 11436 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 18:57:21.128134 11436 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:21.130585 11436 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Loaded TSK: 0
I20260811 18:57:21.132833 11436 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:57:21.382496 11417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:21.382823 11417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:21.383002 11417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:21.390235 11417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:21.390381 11417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:21.390552 11417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:21.400242 11417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:35821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=33431
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:21.401573 11417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:21.402969 11417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:21.417723 11468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:21.417598 11465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:21.418954 11417 server_base.cc:1034] running on GCE node
W20260811 18:57:21.419070 11470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:21.419831 11417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:21.420806 11417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:21.422037 11417 hybrid_clock.cc:648] HybridClock initialized: now 1786474641421976 us; error 50 us; skew 500 ppm
I20260811 18:57:21.422374 11417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:21 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:21.425575 11417 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:21.427177 11417 webserver.cc:460] Webserver started at http://127.19.155.193:33431/ using document root <none> and password file <none>
I20260811 18:57:21.427969 11417 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:21.428128 11417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:21.433460 11417 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260811 18:57:21.436371 11477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.437803 11417 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:21.437973 11417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "79af813e27d647fba7ad22f458d63c63"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "16bb7fb108b18c7f17799b4a99095b07"
server_key_iv: "38e2f8c3b8ff4121211c91b426f74705"
server_key_version: "encryptionkey@0"
I20260811 18:57:21.438957 11417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:21.463711 11417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:21.468140 11417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:21.468425 11417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:21.469441 11417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:21.470783 11417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:21.470883 11417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.471060 11417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:21.471163 11417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.504846 11417 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35821
I20260811 18:57:21.504944 11651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35821 every 8 connection(s)
I20260811 18:57:21.506356 11417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:21.508436 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 11417
I20260811 18:57:21.509289 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:39347
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=39855
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:21 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:21.531279 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.509701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:42783)
0811 18:57:21.510544 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:21.510580 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:21.512381 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:21.513753 (+ 1372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:21.513766 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:21.514389 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:21.515008 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:21.515029 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.516695 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.516705 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:21.517889 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:21.517902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.518963 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.518975 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:21.519227 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:21.519931 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:21.519953 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:21.522326 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:21.527218 (+ 4892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:21.527224 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:21.527235 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:21.527657 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:21.528170 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:21.528173 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:21.528176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:21.528355 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:21.529353 (+ 998us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:21.529359 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:21.529630 (+ 271us) client_negotiation.cc:769] Sending connection context
0811 18:57:21.529841 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 18:57:21.530220 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":345,"threads_started":1}
I20260811 18:57:21.531863 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.509404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:42783 (local address 127.19.155.254:46087)
0811 18:57:21.510169 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:21.510187 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:21.510723 (+ 536us) server_negotiation.cc:407] Connection header received
0811 18:57:21.512927 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:21.512939 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:21.513235 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:21.513608 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:21.515242 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.516527 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.518044 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.518656 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.518853 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:21.522630 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:21.522643 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:21.522663 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:21.522717 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:21.527054 (+ 4337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:21.527816 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:21.527827 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:21.527837 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:21.528054 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:21.528503 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:21.528511 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:21.528517 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:21.529208 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:21.529427 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:21.530130 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 18:57:21.530589 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":355,"threads_started":1}
I20260811 18:57:21.534462 11653 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:21.534765 11653 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:21.535686 11653 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:21.537815 11365 ts_manager.cc:194] Registered new tserver with Master: 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821)
I20260811 18:57:21.539289 11365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:42783
W20260811 18:57:21.858191 11660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:21.858470 11660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:21.858587 11660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:21.866118 11660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:21.866220 11660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:21.866375 11660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:21.876147 11660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:39347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=39855
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:21.877453 11660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:21.878731 11660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:21.891899 11670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:21.891942 11672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:21.891834 11675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:21.893500 11660 server_base.cc:1034] running on GCE node
I20260811 18:57:21.894044 11660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:21.894970 11660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:21.896186 11660 hybrid_clock.cc:648] HybridClock initialized: now 1786474641896125 us; error 55 us; skew 500 ppm
I20260811 18:57:21.896479 11660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:21 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:21.899751 11660 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:21.901242 11660 webserver.cc:460] Webserver started at http://127.19.155.194:39855/ using document root <none> and password file <none>
I20260811 18:57:21.901926 11660 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:21.902076 11660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:21.907325 11660 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:57:21.909927 11686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.911335 11660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:21.911537 11660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "3e70351991104d24b5ecb81651c7f186"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "6bf90ee7366082edc8eaa7ae92d4f4f8"
server_key_iv: "e521119c879b88a7d0b491e0fc69091b"
server_key_version: "encryptionkey@0"
I20260811 18:57:21.912554 11660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:21.927994 11660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:21.932066 11660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:21.932382 11660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:21.933341 11660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:21.934718 11660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:21.934841 11660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.934988 11660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:21.935086 11660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.969826 11660 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39347
I20260811 18:57:21.969918 11855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39347 every 8 connection(s)
I20260811 18:57:21.971477 11660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:21.973171 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 11660
I20260811 18:57:21.973979 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:46013
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=37007
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:57:21 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:21.994594 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.974970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:55029 (local address 127.19.155.254:46087)
0811 18:57:21.975158 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:21.975163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:21.976643 (+ 1480us) server_negotiation.cc:407] Connection header received
0811 18:57:21.978564 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:21.978570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:21.978681 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:21.978799 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:21.980469 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.981209 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.982788 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.983293 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.983427 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:21.987299 (+ 3872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:21.987306 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:21.987312 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:21.987358 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:21.990836 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:21.991847 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:21.991854 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:21.991858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:21.992011 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:21.992574 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:21.992581 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:21.992586 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:21.992937 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:21.993075 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:21.993986 (+ 911us) server_negotiation.cc:299] Negotiation successful
0811 18:57:21.994225 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:57:21.996016 11859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.975581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:55029)
0811 18:57:21.976455 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:21.976493 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:21.978285 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:21.979083 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:21.979092 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:21.979675 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:21.980270 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:21.980294 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.981386 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.981391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:21.982605 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:21.982617 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:21.983526 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:21.983533 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:21.983792 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:21.984519 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:21.984547 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:21.987037 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:21.991013 (+ 3976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:21.991025 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:21.991043 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:21.991686 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:21.992153 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:21.992161 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:21.992167 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:21.992421 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:21.993081 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:21.993092 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:21.993542 (+ 450us) client_negotiation.cc:769] Sending connection context
0811 18:57:21.993866 (+ 324us) client_negotiation.cc:240] Negotiation successful
0811 18:57:21.994494 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":330,"threads_started":1}
I20260811 18:57:21.997573 11857 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:21.997911 11857 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:21.998947 11857 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:22.000705 11365 ts_manager.cc:194] Registered new tserver with Master: 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347)
I20260811 18:57:22.001780 11365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:55029
W20260811 18:57:22.328132 11860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:22.328476 11860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:22.328665 11860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:22.336272 11860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:22.336442 11860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:22.336614 11860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:22.347469 11860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:46013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=37007
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:22.348863 11860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:22.350253 11860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:22.363945 11870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:22.363924 11873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:22.364166 11866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:22.364926 11860 server_base.cc:1034] running on GCE node
I20260811 18:57:22.365592 11860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:22.366559 11860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:22.367823 11860 hybrid_clock.cc:648] HybridClock initialized: now 1786474642367766 us; error 57 us; skew 500 ppm
I20260811 18:57:22.368206 11860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:22 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:22.371608 11860 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:22.373198 11860 webserver.cc:460] Webserver started at http://127.19.155.195:37007/ using document root <none> and password file <none>
I20260811 18:57:22.373927 11860 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:22.374104 11860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:22.379904 11860 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:57:22.382634 11888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:22.384006 11860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:22.384188 11860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "83f880db6808457f8e6ddcb601fb386c"
format_stamp: "Formatted at 2026-08-11 18:57:19 on dist-test-slave-1nl6"
server_key: "46834cce4f51231213cd699debf9c823"
server_key_iv: "8ea02ee55c46321071dcdec611fa0bf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:22.385195 11860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:22.413709 11860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:22.418262 11860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:22.418579 11860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:22.419602 11860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:22.420964 11860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:22.421111 11860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:22.421236 11860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:22.421324 11860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:22.454756 11860 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:46013
I20260811 18:57:22.454862 12089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:46013 every 8 connection(s)
I20260811 18:57:22.456274 11860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:22.459383 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 11860
Aug 11 18:57:22 dist-test-slave-1nl6 krb5kdc[10423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:22.480242 12105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.460415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40694 (local address 127.19.155.254:46087)
0811 18:57:22.463374 (+ 2959us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.463383 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.463972 (+ 589us) server_negotiation.cc:407] Connection header received
0811 18:57:22.464144 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.464149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.464217 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.464304 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.466346 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.467531 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.469442 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.470016 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.470139 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.473610 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.473619 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.473628 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.473673 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.477435 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.478063 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.478071 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.478077 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.478230 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.478598 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.478606 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.478614 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.478949 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.479224 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.479564 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.479786 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":2795,"thread_start_us":2667,"threads_started":1}
I20260811 18:57:22.481647 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.458987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:57389 (local address 127.19.155.254:46087)
0811 18:57:22.459217 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.459223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.460605 (+ 1382us) server_negotiation.cc:407] Connection header received
0811 18:57:22.463819 (+ 3214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.463825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.463918 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.464071 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.466215 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.467524 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.469746 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.470411 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.470498 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.475018 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.475025 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.475029 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.475083 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.478358 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.479118 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.479124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.479128 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.479261 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.479721 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.479726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.479729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.480050 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.480210 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.481060 (+ 850us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.481298 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:57:22.482666 12096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.459544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:57389)
0811 18:57:22.460438 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.460490 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.463533 (+ 3043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.464363 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.464374 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.465155 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:22.466009 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.466037 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.467727 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.467732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.469614 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.469626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.470648 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.470655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.470979 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.471676 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:22.471713 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:22.474765 (+ 3052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:22.478493 (+ 3728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:22.478502 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:22.478524 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:22.478998 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:22.479378 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:22.479383 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:22.479387 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:22.479582 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:22.480208 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:22.480216 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:22.480614 (+ 398us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.480917 (+ 303us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.481395 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":319,"threads_started":1}
I20260811 18:57:22.483940 12090 heartbeater.cc:347] Connected to a master server at 127.19.155.254:46087
I20260811 18:57:22.484261 12090 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:22.484992 12090 heartbeater.cc:511] Master 127.19.155.254:46087 requested a full tablet report, sending...
I20260811 18:57:22.486356 11365 ts_manager.cc:194] Registered new tserver with Master: 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013)
I20260811 18:57:22.487196 11365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:57389
I20260811 18:57:22.495872 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:22.502727 11656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.496723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40696 (local address 127.19.155.254:46087)
0811 18:57:22.496935 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.496942 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.497343 (+ 401us) server_negotiation.cc:407] Connection header received
0811 18:57:22.497606 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.497610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.497752 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.497911 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:22.498361 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.499187 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.500613 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.501036 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.501179 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.501711 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:22.502145 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:22.502316 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.502413 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.502489 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:57:22.503576 11365 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40696:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:22.510695 11365 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:22.533943 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.522664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52056 (local address 127.19.155.193:35821)
0811 18:57:22.525895 (+ 3231us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.525904 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.525934 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:57:22.526040 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.526050 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.526286 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.526512 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:22.527449 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.529113 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.531682 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.532770 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.532997 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.533174 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.533465 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.533618 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3052,"thread_start_us":2936,"threads_started":1}
I20260811 18:57:22.534076 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.522510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35821 (local address 127.0.0.1:52056)
0811 18:57:22.523636 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.523684 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.523871 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.526796 (+ 2925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.526800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.526822 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:22.527254 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.527266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.529269 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.529274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.531505 (+ 2231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.531520 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.533010 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.533016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.533193 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.533252 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.533397 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.533594 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":45,"thread_start_us":1063,"threads_started":1}
I20260811 18:57:22.534794 12118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.522809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:46013 (local address 127.0.0.1:56486)
0811 18:57:22.524718 (+ 1909us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.524747 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.524907 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.526613 (+ 1706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.526620 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.526662 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:22.527191 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.527211 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.529436 (+ 2225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.529444 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.531935 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.531954 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.533837 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.533846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.534074 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.534106 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.534175 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.534344 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1737,"mutex_wait_us":197,"thread_start_us":1573,"threads_started":1}
I20260811 18:57:22.535741 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.523431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.19.155.195:46013)
0811 18:57:22.525549 (+ 2118us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.525558 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.526101 (+ 543us) server_negotiation.cc:407] Connection header received
0811 18:57:22.526194 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.526200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.526385 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.527442 (+ 1057us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:22.527764 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.529255 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.532120 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.533548 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.535012 (+ 1464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.535179 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.535244 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.535406 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1935,"thread_start_us":1787,"threads_started":1}
I20260811 18:57:22.537817 12120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.524772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:39347 (local address 127.0.0.1:46024)
0811 18:57:22.528274 (+ 3502us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.528296 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.528430 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.528979 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.528984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.529008 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:22.529404 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.529422 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.531419 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.531428 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.534690 (+ 3262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.534705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.537083 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.537089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.537263 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.537293 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.537405 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.537520 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3359,"thread_start_us":3200,"threads_started":1}
I20260811 18:57:22.537915 12121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.525444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46024 (local address 127.19.155.194:39347)
0811 18:57:22.527819 (+ 2375us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.527829 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.528406 (+ 577us) server_negotiation.cc:407] Connection header received
0811 18:57:22.528566 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.528574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.528786 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.528958 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:22.529662 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.531269 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.534860 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.536859 (+ 1999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.537062 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.537225 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.537447 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.537600 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2211,"thread_start_us":2065,"threads_started":1}
I20260811 18:57:22.538556 11547 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 (DEFAULT_TABLE table=test-table [id=3401fcf6c7934fc6b28282bf236edd21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:22.540274 11547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab928cfe291497ca0cd14e360a64e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:22.540277 11966 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 (DEFAULT_TABLE table=test-table [id=3401fcf6c7934fc6b28282bf236edd21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:22.541673 11966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab928cfe291497ca0cd14e360a64e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:22.541308 11749 tablet_service.cc:1467] Processing CreateTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 (DEFAULT_TABLE table=test-table [id=3401fcf6c7934fc6b28282bf236edd21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:22.542261 11653 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:22.542574 11749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ab928cfe291497ca0cd14e360a64e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:22.555214 12123 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Bootstrap starting.
I20260811 18:57:22.556285 12125 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Bootstrap starting.
I20260811 18:57:22.559041 12123 tablet_bootstrap.cc:654] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:22.559861 12125 tablet_bootstrap.cc:654] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:22.560384 12123 log.cc:824] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:22.561141 12125 log.cc:824] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:22.561980 12126 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Bootstrap starting.
I20260811 18:57:22.563755 12123 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: No bootstrap required, opened a new log
I20260811 18:57:22.564056 12123 ts_tablet_manager.cc:1397] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 18:57:22.567324 12126 tablet_bootstrap.cc:654] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:22.568437 12126 log.cc:824] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:22.569537 12125 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: No bootstrap required, opened a new log
I20260811 18:57:22.569861 12125 ts_tablet_manager.cc:1397] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260811 18:57:22.571448 12126 tablet_bootstrap.cc:492] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: No bootstrap required, opened a new log
I20260811 18:57:22.571702 12126 ts_tablet_manager.cc:1397] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260811 18:57:22.572180 12123 raft_consensus.cc:348] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.572541 12123 raft_consensus.cc:374] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:22.572667 12123 raft_consensus.cc:729] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e70351991104d24b5ecb81651c7f186, State: Initialized, Role: FOLLOWER
I20260811 18:57:22.573336 12123 consensus_queue.cc:260] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.575634 11857 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:22.577713 12123 ts_tablet_manager.cc:1428] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Time spent starting tablet: real 0.014s user 0.010s sys 0.002s
I20260811 18:57:22.580716 12125 raft_consensus.cc:348] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.581171 12125 raft_consensus.cc:374] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:22.581279 12125 raft_consensus.cc:729] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79af813e27d647fba7ad22f458d63c63, State: Initialized, Role: FOLLOWER
I20260811 18:57:22.581890 12125 consensus_queue.cc:260] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.582289 12126 raft_consensus.cc:348] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.582732 12126 raft_consensus.cc:374] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:22.582870 12126 raft_consensus.cc:729] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f880db6808457f8e6ddcb601fb386c, State: Initialized, Role: FOLLOWER
I20260811 18:57:22.583498 12126 consensus_queue.cc:260] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.583704 12125 ts_tablet_manager.cc:1428] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260811 18:57:22.584651 12090 heartbeater.cc:503] Master 127.19.155.254:46087 was elected leader, sending a full tablet report...
I20260811 18:57:22.585278 12126 ts_tablet_manager.cc:1428] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260811 18:57:22.585546 12135 raft_consensus.cc:482] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:22.585798 12135 raft_consensus.cc:504] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.587869 12135 leader_election.cc:288] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821), 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013)
I20260811 18:57:22.595575 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.588547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:60825 (local address 127.19.155.193:35821)
0811 18:57:22.588742 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.588749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.588833 (+ 84us) server_negotiation.cc:407] Connection header received
0811 18:57:22.589125 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.589130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.589215 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.589287 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:22.590225 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.591382 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.593528 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.594740 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.594850 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.594961 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.595316 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.595404 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:57:22.595780 12138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.588046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35821 (local address 127.19.155.194:60825)
0811 18:57:22.588739 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.588759 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.588952 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.589562 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.589566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.589592 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:22.590007 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.590022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.591504 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.591509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.593367 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.593383 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.594977 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.594984 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.595158 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.595193 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.595295 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.595435 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":1820,"threads_started":1}
I20260811 18:57:22.596772 12139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.588381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:46013 (local address 127.19.155.194:58091)
0811 18:57:22.590463 (+ 2082us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:22.590482 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:22.590606 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:22.590914 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:22.590920 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:22.590945 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:22.591314 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.591327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.592719 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.592723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.594513 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:22.594530 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.596143 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.596151 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:22.596350 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.596375 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:57:22.596450 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:57:22.596540 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1952,"thread_start_us":1761,"threads_started":1}
I20260811 18:57:22.596874 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.589038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:58091 (local address 127.19.155.195:46013)
0811 18:57:22.589262 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.589270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.590567 (+ 1297us) server_negotiation.cc:407] Connection header received
0811 18:57:22.590726 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.590729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.590780 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.590856 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:22.591504 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.592595 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.594674 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.595932 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.596081 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.596154 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.596508 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.596641 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:57:22.596789 11579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab928cfe291497ca0cd14e360a64e73" candidate_uuid: "3e70351991104d24b5ecb81651c7f186" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79af813e27d647fba7ad22f458d63c63" is_pre_election: true
I20260811 18:57:22.597460 11579 raft_consensus.cc:2454] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e70351991104d24b5ecb81651c7f186 in term 0.
I20260811 18:57:22.597851 12009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab928cfe291497ca0cd14e360a64e73" candidate_uuid: "3e70351991104d24b5ecb81651c7f186" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f880db6808457f8e6ddcb601fb386c" is_pre_election: true
I20260811 18:57:22.598121 11691 leader_election.cc:302] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e70351991104d24b5ecb81651c7f186, 79af813e27d647fba7ad22f458d63c63; no voters:
I20260811 18:57:22.598392 12009 raft_consensus.cc:2454] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e70351991104d24b5ecb81651c7f186 in term 0.
I20260811 18:57:22.598569 12135 raft_consensus.cc:2781] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:22.598727 12135 raft_consensus.cc:482] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:22.598847 12135 raft_consensus.cc:3037] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:22.601157 12135 raft_consensus.cc:504] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.601788 12135 leader_election.cc:288] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [CANDIDATE]: Term 1 election: Requested vote from peers 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821), 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013)
I20260811 18:57:22.602250 12009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab928cfe291497ca0cd14e360a64e73" candidate_uuid: "3e70351991104d24b5ecb81651c7f186" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f880db6808457f8e6ddcb601fb386c"
I20260811 18:57:22.602253 11579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ab928cfe291497ca0cd14e360a64e73" candidate_uuid: "3e70351991104d24b5ecb81651c7f186" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79af813e27d647fba7ad22f458d63c63"
I20260811 18:57:22.602452 12009 raft_consensus.cc:3037] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:22.602466 11579 raft_consensus.cc:3037] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:22.604754 11579 raft_consensus.cc:2454] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e70351991104d24b5ecb81651c7f186 in term 1.
I20260811 18:57:22.604830 12009 raft_consensus.cc:2454] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e70351991104d24b5ecb81651c7f186 in term 1.
I20260811 18:57:22.605216 11691 leader_election.cc:302] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e70351991104d24b5ecb81651c7f186, 79af813e27d647fba7ad22f458d63c63; no voters:
I20260811 18:57:22.605607 12135 raft_consensus.cc:2781] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:22.606056 12135 raft_consensus.cc:686] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 1 LEADER]: Becoming Leader. State: Replica: 3e70351991104d24b5ecb81651c7f186, State: Running, Role: LEADER
I20260811 18:57:22.606541 12135 consensus_queue.cc:237] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } }
I20260811 18:57:22.611414 11363 catalog_manager.cc:5495] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e70351991104d24b5ecb81651c7f186 (127.19.155.194). New cstate: current_term: 1 leader_uuid: "3e70351991104d24b5ecb81651c7f186" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e70351991104d24b5ecb81651c7f186" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 39347 } health_report { overall_health: HEALTHY } } }
I20260811 18:57:22.637755 12121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.632252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46028 (local address 127.19.155.194:39347)
0811 18:57:22.632442 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.632446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.632636 (+ 190us) server_negotiation.cc:407] Connection header received
0811 18:57:22.632809 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.632813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.632891 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.633016 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:22.633405 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.634136 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.635757 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.636225 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.636317 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.636794 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:22.637273 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:22.637402 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.637505 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.637565 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:57:22.646438 12009 raft_consensus.cc:1261] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Refusing update from remote peer 3e70351991104d24b5ecb81651c7f186: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:22.646482 11579 raft_consensus.cc:1261] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Refusing update from remote peer 3e70351991104d24b5ecb81651c7f186: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:22.647483 12143 consensus_queue.cc:1035] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79af813e27d647fba7ad22f458d63c63" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:22.647897 12135 consensus_queue.cc:1035] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f880db6808457f8e6ddcb601fb386c" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:22.665405 12153 mvcc.cc:205] Tried to move back new op lower bound from 7317400136268951552 to 7317400136120410112. Current Snapshot: MvccSnapshot[applied={T|T < 7317400136268951552}]
I20260811 18:57:22.671977 11363 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:22.672262 11363 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:22.675978 11363 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Sending DeleteTablet for 3 replicas of tablet 5ab928cfe291497ca0cd14e360a64e73
I20260811 18:57:22.677254 11966 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:56486
I20260811 18:57:22.677259 11749 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46024
I20260811 18:57:22.677294 11547 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ab928cfe291497ca0cd14e360a64e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:22 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:52056
I20260811 18:57:22.679576 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 11417
I20260811 18:57:22.687974 12170 tablet_replica.cc:330] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: stopping tablet replica
I20260811 18:57:22.688723 12170 raft_consensus.cc:2229] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:22.689548 12170 raft_consensus.cc:2258] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:22.690685 12166 tablet_replica.cc:330] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: stopping tablet replica
I20260811 18:57:22.691123 12169 tablet_replica.cc:330] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: stopping tablet replica
I20260811 18:57:22.691581 12166 raft_consensus.cc:2229] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:22.691653 12169 raft_consensus.cc:2229] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:22.692492 12169 raft_consensus.cc:2258] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:22.693293 12166 raft_consensus.cc:2258] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:22.694016 12170 ts_tablet_manager.cc:1905] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:22.695479 12166 ts_tablet_manager.cc:1905] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:22.696034 12169 ts_tablet_manager.cc:1905] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:22.701778 12170 ts_tablet_manager.cc:1918] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:22.702019 12170 log.cc:1196] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/5ab928cfe291497ca0cd14e360a64e73
I20260811 18:57:22.702735 12170 ts_tablet_manager.cc:1939] T 5ab928cfe291497ca0cd14e360a64e73 P 79af813e27d647fba7ad22f458d63c63: Deleting consensus metadata
I20260811 18:57:22.703042 12169 ts_tablet_manager.cc:1918] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:22.703301 12169 log.cc:1196] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/5ab928cfe291497ca0cd14e360a64e73
I20260811 18:57:22.703919 12169 ts_tablet_manager.cc:1939] T 5ab928cfe291497ca0cd14e360a64e73 P 3e70351991104d24b5ecb81651c7f186: Deleting consensus metadata
I20260811 18:57:22.704438 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.681656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52070 (local address 127.19.155.193:35821)
0811 18:57:22.681897 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.681906 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.681930 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:57:22.682005 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.682014 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.682116 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.682237 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.684829 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.686444 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.688850 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.689510 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.689668 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.693732 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.693745 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.693761 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.693806 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.697766 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.701693 (+ 3927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.701704 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.701708 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.701876 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.702325 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.702332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.702335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.702885 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.703241 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.703596 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.703867 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:57:22.704902 11339 catalog_manager.cc:4841] TS 79af813e27d647fba7ad22f458d63c63 (127.19.155.193:35821): tablet 5ab928cfe291497ca0cd14e360a64e73 (table test-table [id=3401fcf6c7934fc6b28282bf236edd21]) successfully deleted
I20260811 18:57:22.705250 12166 ts_tablet_manager.cc:1918] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:22.705400 12166 log.cc:1196] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/5ab928cfe291497ca0cd14e360a64e73
I20260811 18:57:22.705484 11638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:22.705533 11337 catalog_manager.cc:4841] TS 3e70351991104d24b5ecb81651c7f186 (127.19.155.194:39347): tablet 5ab928cfe291497ca0cd14e360a64e73 (table test-table [id=3401fcf6c7934fc6b28282bf236edd21]) successfully deleted
I20260811 18:57:22.706012 12166 ts_tablet_manager.cc:1939] T 5ab928cfe291497ca0cd14e360a64e73 P 83f880db6808457f8e6ddcb601fb386c: Deleting consensus metadata
I20260811 18:57:22.708076 11338 catalog_manager.cc:4841] TS 83f880db6808457f8e6ddcb601fb386c (127.19.155.195:46013): tablet 5ab928cfe291497ca0cd14e360a64e73 (table test-table [id=3401fcf6c7934fc6b28282bf236edd21]) successfully deleted
I20260811 18:57:22.799213 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 11417
I20260811 18:57:22.836107 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 11660
I20260811 18:57:22.850659 12121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.836964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46032 (local address 127.19.155.194:39347)
0811 18:57:22.837223 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.837229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.837248 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:57:22.837424 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.837429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.837505 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.837614 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.839121 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.839907 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.841257 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.841709 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.841855 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.844684 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.844700 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.844715 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.844746 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.847821 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.848506 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.848517 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.848519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.848671 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.849072 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.849077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.849081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.849446 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.849791 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.850051 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.850291 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 18:57:22.851565 11850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:22.962419 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 11660
I20260811 18:57:22.988793 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 11860
I20260811 18:57:23.003579 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.989640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.19.155.195:46013)
0811 18:57:22.989869 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.989874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.989892 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:57:22.990056 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.990060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.990135 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.990217 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.992108 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.992916 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.994755 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.995275 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.995371 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.998382 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.998396 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.998413 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.998442 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:23.001011 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:23.001647 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:23.001654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:23.001656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:23.001785 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:23.002094 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:23.002097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:23.002099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:23.002418 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:23.002639 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:23.002956 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 18:57:23.003203 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:57:23.004244 12084 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:23.093590 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 11860
I20260811 18:57:23.117533 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 11311
I20260811 18:57:23.118741 11407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:23.231390 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 11311
I20260811 18:57:23.261273 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--webserver_interface=127.19.155.254
--webserver_port=41817
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:23.624857 12175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:23.625139 12175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:23.625229 12175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:23.632153 12175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:23.632266 12175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:23.632313 12175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:23.632369 12175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:23.632405 12175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:23.641618 12175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=41817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:23.642860 12175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:23.644112 12175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:23.655977 12189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:23.656064 12186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:23.656016 12187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:23.656857 12175 server_base.cc:1034] running on GCE node
I20260811 18:57:23.657680 12175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:23.659145 12175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:23.660386 12175 hybrid_clock.cc:648] HybridClock initialized: now 1786474643660337 us; error 53 us; skew 500 ppm
I20260811 18:57:23.660778 12175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:23 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474643, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:23.664043 12175 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:23.665630 12175 webserver.cc:460] Webserver started at http://127.19.155.254:41817/ using document root <none> and password file <none>
I20260811 18:57:23.666332 12175 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:23.666481 12175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:23.671953 12175 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:23.674816 12203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:23.676231 12175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:23.676440 12175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "c053c169cd4044daa15b08daba703f81"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-1nl6"
server_key: "f1b6aa222269232b4b2f35b4d96792f7"
server_key_iv: "22435c0d88bcbfcdab37919f96abcc06"
server_key_version: "encryptionkey@0"
I20260811 18:57:23.677389 12175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:23.705874 12175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:23.710201 12175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:23.710496 12175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:23.730341 12175 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46087
I20260811 18:57:23.730374 12291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46087 every 8 connection(s)
I20260811 18:57:23.731925 12175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:23.732654 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 12175
I20260811 18:57:23.733691 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:35821
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=33431
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:23.739027 12293 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:57:23.742214 12293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap starting.
I20260811 18:57:23.767477 12293 log.cc:824] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:23.783883 12293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:57:23.784438 12293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81: Bootstrap complete.
I20260811 18:57:23.793597 12293 raft_consensus.cc:348] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:23.794443 12293 raft_consensus.cc:729] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c053c169cd4044daa15b08daba703f81, State: Initialized, Role: FOLLOWER
I20260811 18:57:23.795178 12293 consensus_queue.cc:260] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:23.795501 12293 raft_consensus.cc:388] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:23.795629 12293 raft_consensus.cc:482] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:23.795835 12293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:57:23.799655 12293 raft_consensus.cc:504] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:23.800170 12293 leader_election.cc:302] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c053c169cd4044daa15b08daba703f81; no voters:
I20260811 18:57:23.800910 12293 leader_election.cc:288] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:57:23.801055 12301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:57:23.802175 12301 raft_consensus.cc:686] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [term 3 LEADER]: Becoming Leader. State: Replica: c053c169cd4044daa15b08daba703f81, State: Running, Role: LEADER
I20260811 18:57:23.802767 12301 consensus_queue.cc:237] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } }
I20260811 18:57:23.803143 12293 sys_catalog.cc:564] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:23.805279 12303 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c053c169cd4044daa15b08daba703f81. Latest consensus state: current_term: 3 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:23.805675 12303 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:23.805447 12302 sys_catalog.cc:455] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c053c169cd4044daa15b08daba703f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c053c169cd4044daa15b08daba703f81" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46087 } } }
I20260811 18:57:23.805840 12302 sys_catalog.cc:458] T 00000000000000000000000000000000 P c053c169cd4044daa15b08daba703f81 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:23.820309 12308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:23.829695 12308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:23.831483 12308 catalog_manager.cc:1259] Loaded cluster ID: 241b50d521ba44f7a3d5a08a5fe3664b
I20260811 18:57:23.831660 12308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 18:57:23.833911 12308 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f57cf3af9ad google::LogMessage::Fail() at ??:0
@ 0x7f57cf3b288a google::LogMessage::SendToLog() at ??:0
@ 0x7f57cf3af4de google::LogMessage::Flush() at ??:0
@ 0x7f57cf3b0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f57e4de2512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f57e4ddf976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f57e4e67610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f57e4e67439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f57d1ffb345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f57d1ffe91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f57d1ffe799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f57d1fd9eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f57d52b36db start_thread at ??:0
@ 0x7f57ce24961f clone at ??:0
W20260811 18:57:24.179644 12296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:24.179939 12296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:24.180038 12296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:24.187477 12296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:24.187583 12296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:24.187711 12296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:24.197921 12296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:35821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=33431
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:24.199239 12296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:24.200529 12296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:24.214479 12361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.214514 12359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.214437 12366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:24.215335 12296 server_base.cc:1034] running on GCE node
I20260811 18:57:24.215996 12296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:24.216944 12296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:24.218178 12296 hybrid_clock.cc:648] HybridClock initialized: now 1786474644218141 us; error 48 us; skew 500 ppm
I20260811 18:57:24.218485 12296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:24 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474644, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:24.221724 12296 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:24.223141 12296 webserver.cc:460] Webserver started at http://127.19.155.193:33431/ using document root <none> and password file <none>
I20260811 18:57:24.223801 12296 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:24.223940 12296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:24.228960 12296 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 18:57:24.231880 12375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.233232 12296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 18:57:24.233419 12296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "79af813e27d647fba7ad22f458d63c63"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "16bb7fb108b18c7f17799b4a99095b07"
server_key_iv: "38e2f8c3b8ff4121211c91b426f74705"
server_key_version: "encryptionkey@0"
I20260811 18:57:24.234395 12296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:24.251981 12296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:24.256319 12296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:24.256608 12296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:24.257604 12296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:24.259039 12296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:24.259181 12296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.259318 12296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:24.259413 12296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.294021 12296 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35821
I20260811 18:57:24.294083 12543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35821 every 8 connection(s)
I20260811 18:57:24.295580 12296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:24.300972 12549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.299078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:60895)
0811 18:57:24.299893 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.300111 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":349,"threads_started":1}
W20260811 18:57:24.301664 12545 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:46087: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
I20260811 18:57:24.302528 12549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.302214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:34947)
0811 18:57:24.302361 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.302428 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 18:57:24.303469 12549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.303137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:57983)
0811 18:57:24.303287 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.303364 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:57:24.303465 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 12296
W20260811 18:57:24.303709 12545 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:57:24.304193 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:39347
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=39855
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:24.645140 12550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:24.645419 12550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:24.645512 12550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:24.652704 12550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:24.652819 12550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:24.652933 12550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:24.662441 12550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:39347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=39855
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:24.663784 12550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:24.665169 12550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:24.678807 12557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.678933 12562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.678848 12556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:24.684211 12550 server_base.cc:1034] running on GCE node
I20260811 18:57:24.684808 12550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:24.685694 12550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:24.686985 12550 hybrid_clock.cc:648] HybridClock initialized: now 1786474644686914 us; error 59 us; skew 500 ppm
I20260811 18:57:24.687347 12550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:24 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474644, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:24.690470 12550 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:24.692063 12550 webserver.cc:460] Webserver started at http://127.19.155.194:39855/ using document root <none> and password file <none>
I20260811 18:57:24.692804 12550 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:24.692957 12550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:24.698272 12550 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 18:57:24.701023 12573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.702266 12550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 18:57:24.702447 12550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "3e70351991104d24b5ecb81651c7f186"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-1nl6"
server_key: "6bf90ee7366082edc8eaa7ae92d4f4f8"
server_key_iv: "e521119c879b88a7d0b491e0fc69091b"
server_key_version: "encryptionkey@0"
I20260811 18:57:24.703464 12550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:24.722018 12550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:24.725960 12550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:24.726254 12550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:24.727368 12550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:24.728667 12550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:24.728807 12550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.728940 12550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:24.729030 12550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.763361 12550 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:39347
I20260811 18:57:24.763433 12750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:39347 every 8 connection(s)
I20260811 18:57:24.764886 12550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:24.769567 12755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.767827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:48027)
0811 18:57:24.768548 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.768766 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":277,"threads_started":1}
W20260811 18:57:24.770258 12752 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:46087: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
I20260811 18:57:24.771025 12755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.770704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:41695)
0811 18:57:24.770836 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.770927 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 18:57:24.771865 12755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.771572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:33379)
0811 18:57:24.771684 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:24.771762 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 18:57:24.772120 12752 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:57:24.773098 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 12550
I20260811 18:57:24.773691 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:46013
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:46087
--webserver_port=37007
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:46215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:25.172430 12758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:25.172868 12758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:25.173020 12758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:25.183876 12758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:25.184036 12758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:25.184230 12758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:25.199345 12758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:46215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:46013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=37007
--tserver_master_addrs=127.19.155.254:46087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:25.201537 12758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:25.203661 12758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:25.223923 12768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:25.223842 12776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:25.223927 12767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:25.225953 12758 server_base.cc:1034] running on GCE node
I20260811 18:57:25.226890 12758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:25.228497 12758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:25.229800 12758 hybrid_clock.cc:648] HybridClock initialized: now 1786474645229728 us; error 83 us; skew 500 ppm
I20260811 18:57:25.230288 12758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:25 dist-test-slave-1nl6 krb5kdc[10423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474645, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:25.235589 12758 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:25.237797 12758 webserver.cc:460] Webserver started at http://127.19.155.195:37007/ using document root <none> and password file <none>
I20260811 18:57:25.238888 12758 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:25.239127 12758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:25.247481 12758 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 18:57:25.251530 12786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:25.253556 12758 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:57:25.253751 12758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "83f880db6808457f8e6ddcb601fb386c"
format_stamp: "Formatted at 2026-08-11 18:57:19 on dist-test-slave-1nl6"
server_key: "46834cce4f51231213cd699debf9c823"
server_key_iv: "8ea02ee55c46321071dcdec611fa0bf9"
server_key_version: "encryptionkey@0"
I20260811 18:57:25.255277 12758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:25.277719 12758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:25.284392 12758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:25.284749 12758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:25.286096 12758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:25.288157 12758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:25.288288 12758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:25.288419 12758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:25.288509 12758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:25.306200 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:25.304793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:47307)
0811 18:57:25.305592 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:25.305794 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":379,"threads_started":1}
I20260811 18:57:25.349104 12758 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:46013
I20260811 18:57:25.349239 12956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:46013 every 8 connection(s)
I20260811 18:57:25.351855 12758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:25.355760 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 12758
I20260811 18:57:25.361940 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:25.357929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:52713)
0811 18:57:25.359611 (+ 1682us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:25.360058 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1014,"thread_start_us":609,"threads_started":1}
W20260811 18:57:25.363193 12958 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:46087 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:46087: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
I20260811 18:57:25.364730 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:25.364102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:37019)
0811 18:57:25.364292 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:25.364560 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 18:57:25.366179 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:25.365616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:58661)
0811 18:57:25.365805 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:25.366015 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 18:57:25.366674 12958 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:57:25.782168 12968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:25.773043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:57163)
0811 18:57:25.775640 (+ 2597us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:25.781745 (+ 6105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2345,"thread_start_us":2071,"threads_started":1}
I20260811 18:57:26.308234 12969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:26.307522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:55715)
0811 18:57:26.307993 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:26.308071 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":230,"threads_started":1}
I20260811 18:57:26.368065 12971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:26.367225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:51595)
0811 18:57:26.367669 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:26.367812 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":222,"threads_started":1}
I20260811 18:57:26.784140 12972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:26.783471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:35211)
0811 18:57:26.783905 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:26.783982 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":212,"threads_started":1}
I20260811 18:57:27.309777 12973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:27.309069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:46295)
0811 18:57:27.309521 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:27.309598 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":227,"threads_started":1}
I20260811 18:57:27.369633 12974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:27.368911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:46061)
0811 18:57:27.369384 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:27.369460 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":236,"threads_started":1}
I20260811 18:57:27.785748 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:27.785014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:42157)
0811 18:57:27.785482 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:27.785565 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":257,"threads_started":1}
I20260811 18:57:28.311432 12976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:28.310676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:48075)
0811 18:57:28.311159 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:28.311239 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":264,"threads_started":1}
I20260811 18:57:28.371325 12979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:28.370572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:35931)
0811 18:57:28.371068 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:28.371150 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":242,"threads_started":1}
I20260811 18:57:28.787642 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:28.786836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:34849)
0811 18:57:28.787393 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:28.787473 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":332,"threads_started":1}
I20260811 18:57:29.313175 12981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:29.312389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:60713)
0811 18:57:29.312926 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:29.313006 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":315,"threads_started":1}
I20260811 18:57:29.372861 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:29.372178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:54599)
0811 18:57:29.372612 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:29.372690 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":216,"threads_started":1}
I20260811 18:57:29.789297 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:29.788550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:39027)
0811 18:57:29.789019 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:29.789107 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":269,"threads_started":1}
I20260811 18:57:30.314733 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:30.314029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:41803)
0811 18:57:30.314481 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:30.314568 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":233,"threads_started":1}
I20260811 18:57:30.374444 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:30.373733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:39881)
0811 18:57:30.374195 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:30.374278 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":247,"threads_started":1}
I20260811 18:57:30.791388 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:30.790362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:43815)
0811 18:57:30.790977 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:30.791131 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":278,"threads_started":1}
I20260811 18:57:31.316460 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:31.315600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:51777)
0811 18:57:31.316135 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:31.316212 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":269,"threads_started":1}
I20260811 18:57:31.376324 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:31.375516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:55819)
0811 18:57:31.376075 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:31.376163 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":286,"threads_started":1}
I20260811 18:57:31.793691 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:31.792701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:45911)
0811 18:57:31.793363 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:31.793461 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":285,"threads_started":1}
I20260811 18:57:32.318063 12994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.317365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:35211)
0811 18:57:32.317797 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.317880 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":212,"threads_started":1}
I20260811 18:57:32.378130 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.377307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:42321)
0811 18:57:32.377810 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.377894 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":217,"threads_started":1}
I20260811 18:57:32.795435 12996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.794695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:46263)
0811 18:57:32.795194 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.795273 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":280,"threads_started":1}
I20260811 18:57:33.319784 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.318992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:35335)
0811 18:57:33.319512 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:33.319592 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":247,"threads_started":1}
I20260811 18:57:33.380225 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.379220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:37287)
0811 18:57:33.379794 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:33.379912 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":279,"threads_started":1}
I20260811 18:57:33.797281 13000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.796388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:46217)
0811 18:57:33.796969 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:33.797091 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":319,"threads_started":1}
I20260811 18:57:34.321409 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:34.320690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:44477)
0811 18:57:34.321151 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:34.321244 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":249,"threads_started":1}
I20260811 18:57:34.381923 13002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:34.381174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:50589)
0811 18:57:34.381669 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:34.381749 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":256,"threads_started":1}
I20260811 18:57:34.798820 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:34.798109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:45163)
0811 18:57:34.798569 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:34.798660 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":262,"threads_started":1}
I20260811 18:57:35.323244 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.322400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:51647)
0811 18:57:35.322870 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.323029 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":227,"threads_started":1}
I20260811 18:57:35.383644 13008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.382840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:47955)
0811 18:57:35.383386 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.383473 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":309,"threads_started":1}
I20260811 18:57:35.800936 13009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.799966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:45741)
0811 18:57:35.800530 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.800643 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":306,"threads_started":1}
I20260811 18:57:36.325167 13010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:36.324368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:39187)
0811 18:57:36.324900 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:36.324981 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":289,"threads_started":1}
I20260811 18:57:36.385464 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:36.384636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:34015)
0811 18:57:36.385154 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:36.385267 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":249,"threads_started":1}
I20260811 18:57:36.803114 13016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:36.802236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:38917)
0811 18:57:36.802801 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:36.802892 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":326,"threads_started":1}
I20260811 18:57:37.327311 13017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.326285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:51187)
0811 18:57:37.326992 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:37.327095 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":358,"threads_started":1}
I20260811 18:57:37.387214 13019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.386469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:37405)
0811 18:57:37.386977 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:37.387059 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":213,"threads_started":1}
I20260811 18:57:37.804956 13020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.804158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:46337)
0811 18:57:37.804650 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:37.804770 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":260,"threads_started":1}
I20260811 18:57:38.329317 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:38.328434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:53219)
0811 18:57:38.329015 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:38.329120 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":253,"threads_started":1}
I20260811 18:57:38.389266 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:38.388363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:50447)
0811 18:57:38.388951 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:38.389057 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":266,"threads_started":1}
I20260811 18:57:38.806849 13027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:38.806043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:34203)
0811 18:57:38.806550 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:38.806642 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":266,"threads_started":1}
I20260811 18:57:39.331727 13029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:39.330669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:53959)
0811 18:57:39.331395 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:39.331533 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":458,"threads_started":1}
I20260811 18:57:39.391026 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:39.390155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:43451)
0811 18:57:39.390633 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:39.390732 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":240,"threads_started":1}
I20260811 18:57:39.808790 13031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:39.808018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.194:34953)
0811 18:57:39.808493 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:39.808614 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":242,"threads_started":1}
I20260811 18:57:40.333961 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:40.333073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.193:47863)
0811 18:57:40.333684 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:40.333796 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":364,"threads_started":1}
I20260811 18:57:40.359354 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 12296
I20260811 18:57:40.387190 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:40.362051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44980 (local address 127.19.155.193:35821)
0811 18:57:40.362769 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:40.362793 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:40.362858 (+ 65us) server_negotiation.cc:407] Connection header received
0811 18:57:40.364711 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:40.364723 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:40.365209 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:40.365558 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:40.367393 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.368766 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.370148 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.371000 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.371191 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:40.379719 (+ 8528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:40.379731 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:40.379752 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:40.379809 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:40.383216 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.384165 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.384175 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.384184 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.384403 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.384862 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.384867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.384869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.385540 (+ 671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:40.385817 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:40.386287 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 18:57:40.386803 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":855,"threads_started":1}
I20260811 18:57:40.388844 12539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:40.393551 13037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:40.392545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46087 (local address 127.19.155.195:48023)
0811 18:57:40.393155 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:40.393292 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:46087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":309,"threads_started":1}
I20260811 18:57:40.478705 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 12296
I20260811 18:57:40.512748 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 12550
I20260811 18:57:40.533759 13038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:40.513883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33728 (local address 127.19.155.194:39347)
0811 18:57:40.514461 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:40.514476 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:40.514516 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:57:40.516274 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:40.516293 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:40.516773 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:40.517186 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:40.518859 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.520422 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.521882 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.522663 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.522899 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:40.526037 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:40.526046 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:40.526067 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:40.526120 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:40.529650 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.530592 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.530600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.530609 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.530824 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.531331 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.531342 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.531345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.531972 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:40.532352 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:40.532861 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 18:57:40.533386 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":262,"threads_started":1}
I20260811 18:57:40.535379 12744 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:40.622795 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 12550
I20260811 18:57:40.654757 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 12758
I20260811 18:57:40.674646 13040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:40.655918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34890 (local address 127.19.155.195:46013)
0811 18:57:40.656595 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:40.656609 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:40.656656 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:57:40.658397 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:40.658408 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:40.658889 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:40.659336 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:40.660814 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.662212 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.663772 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:40.664531 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:40.664707 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:40.667838 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:40.667848 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:40.667868 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:40.667924 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:40.671248 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.672058 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.672065 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.672074 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.672303 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:40.672666 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:40.672669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:40.672671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:40.673282 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:40.673548 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:40.673909 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 18:57:40.674300 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":318,"threads_started":1}
I20260811 18:57:40.676283 12946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:40.762028 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 12758
2026-08-11T18:57:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24907 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:40 dist-test-slave-1nl6 krb5kdc[13044](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:40 dist-test-slave-1nl6 krb5kdc[13044](info): set up 2 sockets
Aug 11 18:57:40 dist-test-slave-1nl6 krb5kdc[13044](info): commencing operation
krb5kdc: starting...
W20260811 18:57:42.173549 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:57:42 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:57:42.519658 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:42.911579 13064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:42.911924 13064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:42.912117 13064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:42.920091 13064 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:57:42.920230 13064 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:57:42.920296 13064 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:57:42.920377 13064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:42.920473 13064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:42.920608 13064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:42.920683 13064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:42.920776 13064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:42.931495 13064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:42.933068 13064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:42.934648 13064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:42.951285 13070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.951375 13077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:42.951299 13071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:42.952591 13064 server_base.cc:1034] running on GCE node
I20260811 18:57:42.953531 13064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:42.955325 13064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:42.956625 13064 hybrid_clock.cc:648] HybridClock initialized: now 1786474662956527 us; error 60 us; skew 500 ppm
I20260811 18:57:42.957021 13064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:42 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:42.961513 13064 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:57:42.963883 13064 webserver.cc:460] Webserver started at http://127.19.155.254:33615/ using document root <none> and password file <none>
I20260811 18:57:42.964803 13064 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:42.964918 13064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:42.965368 13064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:42.968966 13064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "14ddf90850474e39ab2b9e943d4849ad"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-1nl6"
server_key: "cd72605ea5c79831b39a5200e9a3c1b2"
server_key_iv: "6ab639668c41216cf3d050637246f6ca"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.970274 13064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "14ddf90850474e39ab2b9e943d4849ad"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-1nl6"
server_key: "cd72605ea5c79831b39a5200e9a3c1b2"
server_key_iv: "6ab639668c41216cf3d050637246f6ca"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.976939 13064 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260811 18:57:42.981714 13088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:42.983948 13064 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:57:42.984236 13064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "14ddf90850474e39ab2b9e943d4849ad"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-1nl6"
server_key: "cd72605ea5c79831b39a5200e9a3c1b2"
server_key_iv: "6ab639668c41216cf3d050637246f6ca"
server_key_version: "encryptionkey@0"
I20260811 18:57:42.984544 13064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:42.998350 13064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:43.003543 13064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:43.003820 13064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:43.025615 13064 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44723
I20260811 18:57:43.025637 13164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44723 every 8 connection(s)
I20260811 18:57:43.027307 13064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:43.031981 13166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:43.035966 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 13064
I20260811 18:57:43.036221 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:57:43.037106 20079 external_mini_cluster.cc:1428] Setting key e7584a748fedb21b99b0782ac389eb98
I20260811 18:57:43.048867 13166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap starting.
I20260811 18:57:43.053731 13166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:43.055639 13166 log.cc:824] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:57:43 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:43.059780 13166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: No bootstrap required, opened a new log
I20260811 18:57:43.067386 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.039826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47772 (local address 127.19.155.254:44723)
0811 18:57:43.041365 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:43.041384 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:43.041819 (+ 435us) server_negotiation.cc:407] Connection header received
0811 18:57:43.043936 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:43.043967 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:43.044499 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:43.044926 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:43.047234 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.048691 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.050851 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.051719 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.051910 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.058231 (+ 6321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:43.058240 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:43.058259 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:43.058303 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:43.062085 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.063127 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.063137 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.063145 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.063378 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.063884 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.063888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.063890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.064564 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:43.064958 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:43.065542 (+ 584us) server_negotiation.cc:299] Negotiation successful
0811 18:57:43.066076 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1189,"thread_start_us":847,"threads_started":1}
I20260811 18:57:43.068969 13166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:57:43.069453 13166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:43.069599 13166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Initialized, Role: FOLLOWER
I20260811 18:57:43.070250 13166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:57:43.070571 13166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:43.070802 13166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:43.071053 13166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:43.073616 13166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:57:43.074311 13166 leader_election.cc:302] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ddf90850474e39ab2b9e943d4849ad; no voters:
I20260811 18:57:43.075193 13166 leader_election.cc:288] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:43.075364 13171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:43.076642 13171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 LEADER]: Becoming Leader. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Running, Role: LEADER
I20260811 18:57:43.077302 13171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:57:43.077793 13166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:43.081208 13176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ddf90850474e39ab2b9e943d4849ad. Latest consensus state: current_term: 1 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:57:43.081728 13176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:43.082291 13172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:57:43.082607 13172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:43.085610 13187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:43.092053 13187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:43.104019 13187 catalog_manager.cc:1347] Generated new cluster ID: f833e3f230144d4d85b234c83ea534c7
I20260811 18:57:43.104207 13187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:43.121728 13187 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:43.123441 13187 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:43.132416 13187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Generated new TSK 0
I20260811 18:57:43.133742 13187 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:57:43.218541 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:43.634603 13207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:43.635030 13207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:43.635226 13207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:43.643244 13207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:43.643375 13207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:43.643587 13207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:57:43.654547 13207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:43.656085 13207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:43.657569 13207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:43.672588 13215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:43.672667 13216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:43.672695 13218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:43.673858 13207 server_base.cc:1034] running on GCE node
I20260811 18:57:43.674650 13207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:43.675879 13207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:43.677246 13207 hybrid_clock.cc:648] HybridClock initialized: now 1786474663677166 us; error 66 us; skew 500 ppm
I20260811 18:57:43.677678 13207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:43 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:43.681391 13207 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:57:43.683320 13207 webserver.cc:460] Webserver started at http://127.19.155.193:42201/ using document root <none> and password file <none>
I20260811 18:57:43.684270 13207 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:43.684448 13207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:43.684847 13207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:43.688372 13207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "21adfc746bbe401c994f6d4329208374"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-1nl6"
server_key: "22ce74aca7d5ede50c6592364d585be9"
server_key_iv: "c5a527d45540dadeb59928362d3860f9"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.689321 13207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "21adfc746bbe401c994f6d4329208374"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-1nl6"
server_key: "22ce74aca7d5ede50c6592364d585be9"
server_key_iv: "c5a527d45540dadeb59928362d3860f9"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.695725 13207 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 18:57:43.699949 13228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.701678 13207 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:57:43.701879 13207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "21adfc746bbe401c994f6d4329208374"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-1nl6"
server_key: "22ce74aca7d5ede50c6592364d585be9"
server_key_iv: "c5a527d45540dadeb59928362d3860f9"
server_key_version: "encryptionkey@0"
I20260811 18:57:43.702088 13207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:43.723680 13207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:43.729028 13207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:43.729362 13207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:43.730466 13207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:43.732188 13207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:43.732278 13207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.732380 13207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:43.732427 13207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:43.770738 13207 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35795
I20260811 18:57:43.770848 13409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35795 every 8 connection(s)
I20260811 18:57:43.772325 13207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:43.775839 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 13207
I20260811 18:57:43.776130 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:43.776921 20079 external_mini_cluster.cc:1428] Setting key 08e45e868dffc7cf264fb81c677271c3
Aug 11 18:57:43 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474663, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:43.798246 13414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.775474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:37861 (local address 127.19.155.254:44723)
0811 18:57:43.776108 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:43.776117 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:43.777640 (+ 1523us) server_negotiation.cc:407] Connection header received
0811 18:57:43.780807 (+ 3167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:43.780815 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:43.780968 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:43.781111 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:43.783075 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.783855 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.785695 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.786137 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.786327 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.790761 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:43.790767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:43.790771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:43.790814 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:43.793989 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.795122 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.795132 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.795138 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.795336 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:43.795905 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:43.795914 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:43.795919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:43.796357 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:43.796555 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:43.797362 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 18:57:43.797681 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":314,"threads_started":1}
I20260811 18:57:43.799000 13415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:43.776336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:37861)
0811 18:57:43.777335 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:43.777390 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:43.780338 (+ 2948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:43.781442 (+ 1104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:43.781452 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:43.782113 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:43.782809 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:43.782833 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.784076 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.784082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:43.785489 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:43.785506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:43.786483 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:43.786494 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:43.786816 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:43.787699 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:43.787729 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:43.790445 (+ 2716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:43.794257 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:43.794267 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:43.794286 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:43.794839 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:43.795508 (+ 669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:43.795512 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:43.795515 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:43.795759 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:43.796506 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:43.796513 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:43.796915 (+ 402us) client_negotiation.cc:769] Sending connection context
0811 18:57:43.797197 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 18:57:43.797653 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":415,"threads_started":1}
I20260811 18:57:43.800964 13410 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:57:43.801329 13410 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:43.802187 13410 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:57:43.805006 13113 ts_manager.cc:194] Registered new tserver with Master: 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795)
I20260811 18:57:43.807543 13113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:37861
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:57:43.854060 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:44.243417 13418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:44.243767 13418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:44.243947 13418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:44.251786 13418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:44.251930 13418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:44.252177 13418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:57:44.262665 13418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:44.264213 13418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:44.265722 13418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:44.281548 13426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.281916 13425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.282058 13428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.283545 13418 server_base.cc:1034] running on GCE node
I20260811 18:57:44.284406 13418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:44.285738 13418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:44.287055 13418 hybrid_clock.cc:648] HybridClock initialized: now 1786474664287004 us; error 54 us; skew 500 ppm
I20260811 18:57:44.287454 13418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:44 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:44.291263 13418 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:57:44.293079 13418 webserver.cc:460] Webserver started at http://127.19.155.194:45209/ using document root <none> and password file <none>
I20260811 18:57:44.293942 13418 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:44.294118 13418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:44.294488 13418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:44.297940 13418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "0dd99cabac354b60bec0c63ef6b5248f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "584470e8503784cd6513ed4ee99cb6a5"
server_key_iv: "ad9505abe9021615f5be7d3692033c72"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.298858 13418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "0dd99cabac354b60bec0c63ef6b5248f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "584470e8503784cd6513ed4ee99cb6a5"
server_key_iv: "ad9505abe9021615f5be7d3692033c72"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.305306 13418 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:57:44.309757 13441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.311626 13418 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:57:44.311887 13418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "0dd99cabac354b60bec0c63ef6b5248f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "584470e8503784cd6513ed4ee99cb6a5"
server_key_iv: "ad9505abe9021615f5be7d3692033c72"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.312170 13418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:44.344265 13418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:44.349371 13418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:44.349728 13418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:44.350893 13418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:44.352593 13418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:44.352720 13418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.352900 13418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:44.352988 13418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.391234 13418 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44127
I20260811 18:57:44.391292 13613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44127 every 8 connection(s)
I20260811 18:57:44.392795 13418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:44.400547 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 13418
I20260811 18:57:44.400791 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:44.401394 20079 external_mini_cluster.cc:1428] Setting key 726e5ac27a1daee74f39c764c3b69c8f
Aug 11 18:57:44 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:44.419077 13619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:44.395804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:43865 (local address 127.19.155.254:44723)
0811 18:57:44.396331 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:44.396335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:44.397268 (+ 933us) server_negotiation.cc:407] Connection header received
0811 18:57:44.399282 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:44.399288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:44.399388 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:44.399518 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:44.401878 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.402762 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.405384 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.405944 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.406086 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:44.411483 (+ 5397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:44.411490 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:44.411493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:44.411537 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:44.414504 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.415760 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.415765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.415767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.415921 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:44.416573 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:44.416578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:44.416580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:44.416923 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:44.417118 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:44.418346 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0811 18:57:44.418656 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":282,"threads_started":1}
I20260811 18:57:44.420275 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:44.396286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:43865)
0811 18:57:44.397065 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:44.397113 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:44.398893 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:44.399811 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:44.399821 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:44.400669 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:44.401610 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:44.401640 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.403000 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.403004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:44.405155 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:44.405181 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:44.406248 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:44.406260 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:44.406662 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:44.407652 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:44.407690 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:44.411120 (+ 3430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:44.414745 (+ 3625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:44.414759 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:44.414785 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:44.415596 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:44.416069 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:44.416077 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:44.416083 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:44.416399 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:44.417100 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:44.417113 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:44.417673 (+ 560us) client_negotiation.cc:769] Sending connection context
0811 18:57:44.418226 (+ 553us) client_negotiation.cc:240] Negotiation successful
0811 18:57:44.418862 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":316,"threads_started":1}
I20260811 18:57:44.422079 13614 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:57:44.422456 13614 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:44.423388 13614 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:57:44.425304 13113 ts_manager.cc:194] Registered new tserver with Master: 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127)
I20260811 18:57:44.426750 13113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:43865
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:57:44.476390 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:44.811432 13410 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
W20260811 18:57:44.861331 13627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:44.861681 13627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:44.861791 13627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:44.869534 13627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:44.869678 13627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:44.869801 13627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:57:44.881273 13627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:57:44.882728 13627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:44.884351 13627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:44.900409 13633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.900297 13637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:44.900265 13634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:44.901490 13627 server_base.cc:1034] running on GCE node
I20260811 18:57:44.902359 13627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:44.903631 13627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:44.904919 13627 hybrid_clock.cc:648] HybridClock initialized: now 1786474664904859 us; error 60 us; skew 500 ppm
I20260811 18:57:44.905344 13627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:57:44 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:44.909479 13627 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:57:44.911473 13627 webserver.cc:460] Webserver started at http://127.19.155.195:42835/ using document root <none> and password file <none>
I20260811 18:57:44.912309 13627 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:44.912448 13627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:44.912756 13627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:44.916404 13627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "94aa4ea31652491b87f10f85a457110f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "d4134b343cfc7ab63f480c39964e091b"
server_key_iv: "be2c97b5205d987d3522cfe97b581d6a"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.917424 13627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "94aa4ea31652491b87f10f85a457110f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "d4134b343cfc7ab63f480c39964e091b"
server_key_iv: "be2c97b5205d987d3522cfe97b581d6a"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.924026 13627 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:57:44.928627 13646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.930467 13627 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 18:57:44.930665 13627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "94aa4ea31652491b87f10f85a457110f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "d4134b343cfc7ab63f480c39964e091b"
server_key_iv: "be2c97b5205d987d3522cfe97b581d6a"
server_key_version: "encryptionkey@0"
I20260811 18:57:44.930878 13627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:44.954013 13627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:44.959067 13627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:44.959357 13627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:44.960615 13627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:44.962205 13627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:44.962296 13627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:44.962406 13627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:44.962455 13627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:45.004673 13627 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:37675
I20260811 18:57:45.004724 13819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:37675 every 8 connection(s)
I20260811 18:57:45.006326 13627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:45.012830 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 13627
I20260811 18:57:45.013231 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:45.014175 20079 external_mini_cluster.cc:1428] Setting key fe39611e16d6509c15622613bc642331
Aug 11 18:57:45 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474664, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:57:45.033195 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.009520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:46671 (local address 127.19.155.254:44723)
0811 18:57:45.010100 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.010108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.011333 (+ 1225us) server_negotiation.cc:407] Connection header received
0811 18:57:45.013736 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.013742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.013884 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.014052 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.016540 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.017728 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.019696 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.020148 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.020319 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.024636 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.024643 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.024647 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.024689 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.028234 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.029481 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.029487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.029489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.029720 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.030326 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.030333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.030337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.030778 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.030987 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.032384 (+ 1397us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.032729 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":266,"threads_started":1}
I20260811 18:57:45.034310 13825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.010140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:46671)
0811 18:57:45.011123 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.011181 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.013136 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.014428 (+ 1292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.014440 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.015255 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:45.016240 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.016267 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.017954 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.017959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.019485 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.019505 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.020451 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.020463 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.020756 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.021600 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:45.021632 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:45.024292 (+ 2660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:45.028504 (+ 4212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.028516 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.028535 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.029307 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.029875 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:45.029885 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:45.029887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:45.030145 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:45.031080 (+ 935us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:45.031091 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:45.031647 (+ 556us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.032027 (+ 380us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.032721 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":374,"threads_started":1}
I20260811 18:57:45.036569 13822 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:57:45.036969 13822 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:45.037853 13822 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:57:45.039841 13113 ts_manager.cc:194] Registered new tserver with Master: 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675)
I20260811 18:57:45.040772 13113 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:46671
I20260811 18:57:45.044066 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:45.065239 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.049313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47784 (local address 127.19.155.254:44723)
0811 18:57:45.049617 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.049624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.049868 (+ 244us) server_negotiation.cc:407] Connection header received
0811 18:57:45.050079 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.050083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.050159 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.050271 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.052097 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.052975 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.054655 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.055243 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.055379 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.058299 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.058308 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.058313 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.058376 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.061725 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.062765 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.062771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.062774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.063057 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.063510 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.063514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.063516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.063895 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.064140 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.064547 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.064798 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 18:57:45.070345 13113 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:45.078058 13113 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:45.106760 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.094569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:37675 (local address 127.0.0.1:54208)
0811 18:57:45.095539 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.095593 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.095835 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.097906 (+ 2071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.097914 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.097977 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.098987 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.099005 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.101359 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.101367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.103996 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.104014 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.105693 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.105701 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.105938 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.106001 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.106181 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.106384 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":404,"spinlock_wait_cycles":1408,"thread_start_us":545,"threads_started":1}
I20260811 18:57:45.107746 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.095045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54208 (local address 127.19.155.195:37675)
0811 18:57:45.097312 (+ 2267us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.097325 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.097353 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:57:45.097433 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.097437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.097619 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.098434 (+ 815us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.099285 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.101199 (+ 1914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.104230 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.105438 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.105699 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.105948 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.107180 (+ 1232us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.107415 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2101,"thread_start_us":1937,"threads_started":1}
I20260811 18:57:45.108027 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.095224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:40152)
0811 18:57:45.096471 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.096503 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.096656 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.097905 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.097914 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.098019 (+ 105us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.098677 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.098694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.101019 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.101026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.103903 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.103923 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.106695 (+ 2772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.106702 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.106988 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.107036 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.107153 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.107515 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1069,"mutex_wait_us":67,"spinlock_wait_cycles":94464,"thread_start_us":961,"threads_started":1}
I20260811 18:57:45.109035 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.095963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.19.155.193:35795)
0811 18:57:45.097183 (+ 1220us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.097193 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.097241 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:57:45.097360 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.097369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.097664 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.097898 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.098972 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.100806 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.104162 (+ 3356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.105996 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.106333 (+ 337us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.106535 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.108386 (+ 1851us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.108613 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1040,"thread_start_us":844,"threads_started":1}
I20260811 18:57:45.112063 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.098871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36768 (local address 127.19.155.194:44127)
0811 18:57:45.101048 (+ 2177us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.101061 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.101097 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:57:45.101237 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.101246 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.101572 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.101829 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.102786 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.104435 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.107369 (+ 2934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.110662 (+ 3293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.110888 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.111126 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.111524 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.111724 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1971,"thread_start_us":1811,"threads_started":1}
I20260811 18:57:45.112102 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.098025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44127 (local address 127.0.0.1:36768)
0811 18:57:45.100329 (+ 2304us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.100357 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.100481 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.101830 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.101835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.101871 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.102520 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.102535 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.104613 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.104620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.107116 (+ 2496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.107136 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.111018 (+ 3882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.111027 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.111264 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.111308 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.111441 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.111625 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2142,"thread_start_us":385,"threads_started":1}
I20260811 18:57:45.112666 13717 tablet_service.cc:1467] Processing CreateTablet for tablet 2db1e2943469434295f82ded5617c989 (DEFAULT_TABLE table=test-table [id=b79d79d48bd749ddb0de91768c954b16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.113369 13294 tablet_service.cc:1467] Processing CreateTablet for tablet 2db1e2943469434295f82ded5617c989 (DEFAULT_TABLE table=test-table [id=b79d79d48bd749ddb0de91768c954b16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.114660 13717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db1e2943469434295f82ded5617c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.115852 13294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db1e2943469434295f82ded5617c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.117223 13514 tablet_service.cc:1467] Processing CreateTablet for tablet 2db1e2943469434295f82ded5617c989 (DEFAULT_TABLE table=test-table [id=b79d79d48bd749ddb0de91768c954b16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:45.119104 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db1e2943469434295f82ded5617c989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:45.129532 13848 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Bootstrap starting.
I20260811 18:57:45.133268 13848 tablet_bootstrap.cc:654] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.134730 13850 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Bootstrap starting.
I20260811 18:57:45.134845 13848 log.cc:824] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.140579 13850 tablet_bootstrap.cc:654] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.142742 13850 log.cc:824] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.143236 13852 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Bootstrap starting.
I20260811 18:57:45.147253 13848 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: No bootstrap required, opened a new log
I20260811 18:57:45.147503 13852 tablet_bootstrap.cc:654] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:45.147635 13850 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: No bootstrap required, opened a new log
I20260811 18:57:45.147747 13848 ts_tablet_manager.cc:1397] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20260811 18:57:45.147953 13850 ts_tablet_manager.cc:1397] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.005s
I20260811 18:57:45.148818 13852 log.cc:824] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:45.153733 13852 tablet_bootstrap.cc:492] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: No bootstrap required, opened a new log
I20260811 18:57:45.154103 13852 ts_tablet_manager.cc:1397] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260811 18:57:45.160087 13848 raft_consensus.cc:348] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.160069 13850 raft_consensus.cc:348] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.160725 13848 raft_consensus.cc:374] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.160725 13850 raft_consensus.cc:374] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.160856 13850 raft_consensus.cc:729] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21adfc746bbe401c994f6d4329208374, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.160889 13848 raft_consensus.cc:729] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94aa4ea31652491b87f10f85a457110f, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.161729 13850 consensus_queue.cc:260] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.161729 13848 consensus_queue.cc:260] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.163368 13822 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
I20260811 18:57:45.164378 13850 ts_tablet_manager.cc:1428] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260811 18:57:45.164662 13852 raft_consensus.cc:348] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.165331 13852 raft_consensus.cc:374] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:45.165426 13848 ts_tablet_manager.cc:1428] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Time spent starting tablet: real 0.018s user 0.014s sys 0.002s
I20260811 18:57:45.165506 13852 raft_consensus.cc:729] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dd99cabac354b60bec0c63ef6b5248f, State: Initialized, Role: FOLLOWER
I20260811 18:57:45.166378 13852 consensus_queue.cc:260] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.167816 13614 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
I20260811 18:57:45.168610 13852 ts_tablet_manager.cc:1428] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
I20260811 18:57:45.209107 13856 raft_consensus.cc:482] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:45.209467 13856 raft_consensus.cc:504] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.211493 13856 leader_election.cc:288] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795), 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127)
I20260811 18:57:45.218159 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.212546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:56463 (local address 127.19.155.194:44127)
0811 18:57:45.212752 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.212757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.212775 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:57:45.212853 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.212856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.212917 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.213049 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.213480 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.214223 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.216035 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.217084 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.217257 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.217343 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.217720 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.217868 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:57:45.218159 13825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.211794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44127 (local address 127.19.155.195:56463)
0811 18:57:45.212011 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.212041 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.212232 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.213081 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.213086 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.213120 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.213323 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.213333 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.214382 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.214389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.215834 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.215849 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.217256 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.217262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.217487 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.217514 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.217684 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.217846 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:57:45.219484 13540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db1e2943469434295f82ded5617c989" candidate_uuid: "94aa4ea31652491b87f10f85a457110f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dd99cabac354b60bec0c63ef6b5248f" is_pre_election: true
I20260811 18:57:45.220139 13540 raft_consensus.cc:2454] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94aa4ea31652491b87f10f85a457110f in term 0.
I20260811 18:57:45.220458 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.212064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:56573 (local address 127.19.155.193:35795)
0811 18:57:45.212366 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.212382 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.213101 (+ 719us) server_negotiation.cc:407] Connection header received
0811 18:57:45.213397 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.213402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.213466 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.213574 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:45.214148 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.214883 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.216865 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.218891 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.219519 (+ 628us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.219633 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.220001 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.220161 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260811 18:57:45.220546 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.212048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.19.155.195:56573)
0811 18:57:45.212969 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:45.212986 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:45.213227 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:45.213593 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:45.213597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:45.213623 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:45.213977 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.213986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.215105 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.215111 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.216658 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:45.216672 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.219521 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.219540 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:45.219752 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.219820 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 18:57:45.219967 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 18:57:45.220124 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"spinlock_wait_cycles":41088,"thread_start_us":542,"threads_started":1}
I20260811 18:57:45.220950 13650 leader_election.cc:302] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dd99cabac354b60bec0c63ef6b5248f, 94aa4ea31652491b87f10f85a457110f; no voters:
I20260811 18:57:45.221397 13856 raft_consensus.cc:2781] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:45.221571 13856 raft_consensus.cc:482] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:45.221695 13856 raft_consensus.cc:3037] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.221800 13330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db1e2943469434295f82ded5617c989" candidate_uuid: "94aa4ea31652491b87f10f85a457110f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21adfc746bbe401c994f6d4329208374" is_pre_election: true
I20260811 18:57:45.222404 13330 raft_consensus.cc:2454] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94aa4ea31652491b87f10f85a457110f in term 0.
I20260811 18:57:45.224327 13856 raft_consensus.cc:504] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.225109 13856 leader_election.cc:288] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [CANDIDATE]: Term 1 election: Requested vote from peers 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795), 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127)
I20260811 18:57:45.225630 13330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db1e2943469434295f82ded5617c989" candidate_uuid: "94aa4ea31652491b87f10f85a457110f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21adfc746bbe401c994f6d4329208374"
I20260811 18:57:45.225785 13540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db1e2943469434295f82ded5617c989" candidate_uuid: "94aa4ea31652491b87f10f85a457110f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dd99cabac354b60bec0c63ef6b5248f"
I20260811 18:57:45.225921 13330 raft_consensus.cc:3037] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.226068 13540 raft_consensus.cc:3037] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:45.228679 13330 raft_consensus.cc:2454] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94aa4ea31652491b87f10f85a457110f in term 1.
I20260811 18:57:45.228688 13540 raft_consensus.cc:2454] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94aa4ea31652491b87f10f85a457110f in term 1.
I20260811 18:57:45.229288 13650 leader_election.cc:302] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dd99cabac354b60bec0c63ef6b5248f, 94aa4ea31652491b87f10f85a457110f; no voters:
I20260811 18:57:45.229771 13856 raft_consensus.cc:2781] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:45.230342 13856 raft_consensus.cc:686] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 1 LEADER]: Becoming Leader. State: Replica: 94aa4ea31652491b87f10f85a457110f, State: Running, Role: LEADER
I20260811 18:57:45.230966 13856 consensus_queue.cc:237] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:57:45.236640 13110 catalog_manager.cc:5495] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f reported cstate change: term changed from 0 to 1, leader changed from <none> to 94aa4ea31652491b87f10f85a457110f (127.19.155.195). New cstate: current_term: 1 leader_uuid: "94aa4ea31652491b87f10f85a457110f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } health_report { overall_health: UNKNOWN } } }
W20260811 18:57:45.258344 13823 tablet.cc:2369] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:45.272050 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.265938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54216 (local address 127.19.155.195:37675)
0811 18:57:45.266144 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.266149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.266169 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:57:45.266273 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.266277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.266381 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.266532 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:45.267061 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.267815 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.269625 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.270067 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.270181 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.270777 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:45.271465 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:45.271592 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.271738 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.271830 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 18:57:45.275372 13411 tablet.cc:2369] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:45.282716 13540 raft_consensus.cc:1261] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Refusing update from remote peer 94aa4ea31652491b87f10f85a457110f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:45.282716 13330 raft_consensus.cc:1261] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Refusing update from remote peer 94aa4ea31652491b87f10f85a457110f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:45.284168 13856 consensus_queue.cc:1035] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:45.284610 13862 consensus_queue.cc:1035] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:45.304243 13869 mvcc.cc:205] Tried to move back new op lower bound from 7317400228983812096 to 7317400228790812672. Current Snapshot: MvccSnapshot[applied={T|T < 7317400228983812096}]
I20260811 18:57:45.318696 13111 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:45.319145 13111 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:45.323869 13111 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Sending DeleteTablet for 3 replicas of tablet 2db1e2943469434295f82ded5617c989
I20260811 18:57:45.325459 13294 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db1e2943469434295f82ded5617c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:45 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:40152
I20260811 18:57:45.325459 13514 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db1e2943469434295f82ded5617c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:45 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:36768
I20260811 18:57:45.326833 13717 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db1e2943469434295f82ded5617c989 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:45 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:54208
I20260811 18:57:45.327322 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 13207
I20260811 18:57:45.337339 13880 tablet_replica.cc:330] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: stopping tablet replica
I20260811 18:57:45.338228 13880 raft_consensus.cc:2229] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:45.339094 13880 raft_consensus.cc:2258] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:45.340248 13878 tablet_replica.cc:330] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: stopping tablet replica
I20260811 18:57:45.341096 13878 raft_consensus.cc:2229] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:45.343451 13880 ts_tablet_manager.cc:1905] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:45.346544 13878 raft_consensus.cc:2258] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:45.351102 13878 ts_tablet_manager.cc:1905] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:45.352077 13881 tablet_replica.cc:330] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: stopping tablet replica
I20260811 18:57:45.352859 13881 raft_consensus.cc:2229] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:57:45.353349 13880 ts_tablet_manager.cc:1918] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:45.353605 13880 log.cc:1196] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/2db1e2943469434295f82ded5617c989
I20260811 18:57:45.354089 13881 raft_consensus.cc:2258] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:45.354688 13880 ts_tablet_manager.cc:1939] T 2db1e2943469434295f82ded5617c989 P 21adfc746bbe401c994f6d4329208374: Deleting consensus metadata
I20260811 18:57:45.357039 13881 ts_tablet_manager.cc:1905] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:45.357287 13093 catalog_manager.cc:4841] TS 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795): tablet 2db1e2943469434295f82ded5617c989 (table test-table [id=b79d79d48bd749ddb0de91768c954b16]) successfully deleted
Aug 11 18:57:45 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:57:45.365522 13878 ts_tablet_manager.cc:1918] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:45.365942 13878 log.cc:1196] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/2db1e2943469434295f82ded5617c989
I20260811 18:57:45.366649 13878 ts_tablet_manager.cc:1939] T 2db1e2943469434295f82ded5617c989 P 0dd99cabac354b60bec0c63ef6b5248f: Deleting consensus metadata
I20260811 18:57:45.367406 13881 ts_tablet_manager.cc:1918] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:45.367708 13881 log.cc:1196] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/2db1e2943469434295f82ded5617c989
I20260811 18:57:45.368589 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.328927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40162 (local address 127.19.155.193:35795)
0811 18:57:45.329189 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.329198 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.344319 (+ 15121us) server_negotiation.cc:407] Connection header received
0811 18:57:45.344878 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.344885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.344988 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.345068 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.348577 (+ 3509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.349723 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.351898 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.352663 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.352779 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.359458 (+ 6679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.359481 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.359505 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.359560 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.364072 (+ 4512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.365314 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.365328 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.365334 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.365543 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.366110 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.366116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.366120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.366638 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.367022 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.367785 (+ 763us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.368114 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 18:57:45.368593 13881 ts_tablet_manager.cc:1939] T 2db1e2943469434295f82ded5617c989 P 94aa4ea31652491b87f10f85a457110f: Deleting consensus metadata
I20260811 18:57:45.369366 13092 catalog_manager.cc:4841] TS 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127): tablet 2db1e2943469434295f82ded5617c989 (table test-table [id=b79d79d48bd749ddb0de91768c954b16]) successfully deleted
I20260811 18:57:45.370631 13404 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:45.371335 13092 catalog_manager.cc:4841] TS 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675): tablet 2db1e2943469434295f82ded5617c989 (table test-table [id=b79d79d48bd749ddb0de91768c954b16]) successfully deleted
I20260811 18:57:45.464811 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 13207
I20260811 18:57:45.503602 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 13418
Aug 11 18:57:45 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:57:45.527109 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.504798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36782 (local address 127.19.155.194:44127)
0811 18:57:45.505099 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.505105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.505126 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:57:45.505194 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.505198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.505270 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.505398 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.507023 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.507824 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.509313 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.509767 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.509920 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.519458 (+ 9538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.519478 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.519500 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.519556 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.523254 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.524267 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.524277 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.524279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.524454 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.524939 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.524946 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.524955 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.525428 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.525816 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.526298 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.526577 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260811 18:57:45.527984 13607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:45.624502 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 13418
I20260811 18:57:45.659749 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 13627
Aug 11 18:57:45 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:57:45.681535 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:45.660856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54226 (local address 127.19.155.195:37675)
0811 18:57:45.661088 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:45.661095 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:45.661121 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:45.661291 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:45.661297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:45.661417 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:45.661553 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:45.663863 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.664782 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.666856 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:45.667460 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:45.667592 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:45.674200 (+ 6608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:45.674218 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:45.674237 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:45.674298 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:45.677983 (+ 3685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.678997 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.679006 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.679008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.679200 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:45.679670 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:45.679675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:45.679680 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:45.680116 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:45.680478 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:45.680862 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 18:57:45.681129 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:57:45.682431 13814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:45.812386 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 13627
I20260811 18:57:45.850152 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 13064
I20260811 18:57:45.851464 13157 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:57:45.965983 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 13064
I20260811 18:58:06.006367 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--webserver_interface=127.19.155.254
--webserver_port=33615
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:06.375976 13890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:06.376322 13890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:06.376497 13890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:06.384140 13890 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:58:06.384270 13890 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:58:06.384349 13890 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:58:06.384438 13890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:06.384541 13890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:06.384678 13890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:06.384753 13890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:06.384843 13890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:06.395308 13890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=33615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:06.396756 13890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:06.398285 13890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:06.428045 13900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:06.428031 13903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:06.428115 13899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:06.432716 13890 server_base.cc:1034] running on GCE node
I20260811 18:58:06.433661 13890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:06.435396 13890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:06.436683 13890 hybrid_clock.cc:648] HybridClock initialized: now 1786474686436612 us; error 38 us; skew 500 ppm
I20260811 18:58:06.437135 13890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:06 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474686, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:06.445988 13890 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:58:06.448393 13890 webserver.cc:460] Webserver started at http://127.19.155.254:33615/ using document root <none> and password file <none>
I20260811 18:58:06.449321 13890 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:06.449494 13890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:06.456069 13890 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 18:58:06.459353 13911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:06.460934 13890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:58:06.461141 13890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "14ddf90850474e39ab2b9e943d4849ad"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-1nl6"
server_key: "cd72605ea5c79831b39a5200e9a3c1b2"
server_key_iv: "6ab639668c41216cf3d050637246f6ca"
server_key_version: "encryptionkey@0"
I20260811 18:58:06.462249 13890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:06.488381 13890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:06.492766 13890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:06.493072 13890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:06.513020 13890 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44723
I20260811 18:58:06.513063 14000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44723 every 8 connection(s)
I20260811 18:58:06.514680 13890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:06.521688 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 13890
I20260811 18:58:06.522398 14003 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:58:06.522574 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:35795
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=42201
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:58:06.526080 14003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap starting.
I20260811 18:58:06.547338 14003 log.cc:824] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:06.560439 14003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:58:06.561054 14003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap complete.
I20260811 18:58:06.571008 14003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:06.571939 14003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Initialized, Role: FOLLOWER
I20260811 18:58:06.572610 14003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:06.572894 14003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:06.573040 14003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:06.573242 14003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:58:06.577806 14003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:06.578387 14003 leader_election.cc:302] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ddf90850474e39ab2b9e943d4849ad; no voters:
I20260811 18:58:06.579154 14003 leader_election.cc:288] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:58:06.579373 14012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:58:06.580581 14012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 LEADER]: Becoming Leader. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Running, Role: LEADER
I20260811 18:58:06.581283 14012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:06.581703 14003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:06.584228 14014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ddf90850474e39ab2b9e943d4849ad. Latest consensus state: current_term: 2 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:58:06.584762 14014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:06.585322 14013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:58:06.585721 14013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:06.586799 14021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:06.606801 14021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:06.608515 14021 catalog_manager.cc:1259] Loaded cluster ID: f833e3f230144d4d85b234c83ea534c7
I20260811 18:58:06.608675 14021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:06.613201 14021 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:06.614881 14021 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Loaded TSK: 0
I20260811 18:58:06.645694 14039 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:58:06.652813 14021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Generated new TSK 1
I20260811 18:58:06.653288 14021 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:58:06.903508 14007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:06.903800 14007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:06.903949 14007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:06.911612 14007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:06.911732 14007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:06.911902 14007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:58:06.922119 14007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:35795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=42201
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:06.923607 14007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:06.925005 14007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:06.940238 14046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:06.940245 14047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:06.941105 14049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:06.942094 14007 server_base.cc:1034] running on GCE node
I20260811 18:58:06.942828 14007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:06.943921 14007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:06.945179 14007 hybrid_clock.cc:648] HybridClock initialized: now 1786474686945112 us; error 48 us; skew 500 ppm
I20260811 18:58:06.945549 14007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:06 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474686, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:06.949177 14007 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:58:06.950886 14007 webserver.cc:460] Webserver started at http://127.19.155.193:42201/ using document root <none> and password file <none>
I20260811 18:58:06.951679 14007 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:06.951849 14007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:06.957834 14007 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 18:58:06.960897 14058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:06.962440 14007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:58:06.962654 14007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "21adfc746bbe401c994f6d4329208374"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-1nl6"
server_key: "22ce74aca7d5ede50c6592364d585be9"
server_key_iv: "c5a527d45540dadeb59928362d3860f9"
server_key_version: "encryptionkey@0"
I20260811 18:58:06.963821 14007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:06.992514 14007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:06.997597 14007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:06.997920 14007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:06.999130 14007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:07.000748 14007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:07.000880 14007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.001020 14007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:07.001108 14007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.036360 14007 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35795
I20260811 18:58:07.036453 14242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35795 every 8 connection(s)
I20260811 18:58:07.037918 14007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:07.045396 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 14007
I20260811 18:58:07.046231 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:44127
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=45209
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:58:07 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474686, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:07.065779 14247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.041025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:57795 (local address 127.19.155.254:44723)
0811 18:58:07.041654 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.041666 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.042489 (+ 823us) server_negotiation.cc:407] Connection header received
0811 18:58:07.044785 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.044799 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.045153 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.045629 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.047918 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.049417 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.052069 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.052794 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.052953 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.057551 (+ 4598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.057561 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.057577 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.057629 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.060769 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.061638 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.061646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.061651 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.061838 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.062324 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.062328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.062330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.062855 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.063112 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.063975 (+ 863us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.064398 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":277,"threads_started":1}
I20260811 18:58:07.065791 14248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.041304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:57795)
0811 18:58:07.042290 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:07.042346 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:07.044245 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:07.045805 (+ 1560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:07.045819 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:07.046764 (+ 945us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:07.047655 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.047685 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.049601 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.049609 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.051858 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.051878 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.053067 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.053078 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.053430 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.054246 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:07.054286 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:07.057194 (+ 2908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:07.060953 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.060963 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.060981 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.061465 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.061967 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.061972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.061976 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.062180 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.063069 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:07.063077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:07.063437 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 18:58:07.063726 (+ 289us) client_negotiation.cc:240] Negotiation successful
0811 18:58:07.064357 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":415,"threads_started":1}
I20260811 18:58:07.069506 14243 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:58:07.069890 14243 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:07.070981 14243 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:58:07.073649 13944 ts_manager.cc:194] Registered new tserver with Master: 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795)
I20260811 18:58:07.075325 13944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:57795
W20260811 18:58:07.407037 14249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.407382 14249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.407534 14249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.415386 14249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.415532 14249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.415719 14249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:58:07.425877 14249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:44127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=45209
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:07.427313 14249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.429052 14249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.443188 14258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.443235 14259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.443284 14261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.443768 14249 server_base.cc:1034] running on GCE node
I20260811 18:58:07.444625 14249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.445758 14249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.447021 14249 hybrid_clock.cc:648] HybridClock initialized: now 1786474687446941 us; error 51 us; skew 500 ppm
I20260811 18:58:07.447346 14249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:07 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.450724 14249 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:58:07.452441 14249 webserver.cc:460] Webserver started at http://127.19.155.194:45209/ using document root <none> and password file <none>
I20260811 18:58:07.453208 14249 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.453385 14249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.459555 14249 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:58:07.462569 14277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.464154 14249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:07.464388 14249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "0dd99cabac354b60bec0c63ef6b5248f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "584470e8503784cd6513ed4ee99cb6a5"
server_key_iv: "ad9505abe9021615f5be7d3692033c72"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.465440 14249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:07.499329 14249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:07.503815 14249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:07.504117 14249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:07.505180 14249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:07.506594 14249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:07.506721 14249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.506867 14249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:07.506991 14249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 18:58:07.544579 14249 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44127
I20260811 18:58:07.544636 14455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44127 every 8 connection(s)
I20260811 18:58:07.546182 14249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:07.553050 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 14249
I20260811 18:58:07.553735 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:37675
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=42835
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:58:07 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:07.567567 14247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.549075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:35875 (local address 127.19.155.254:44723)
0811 18:58:07.549276 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:07.549281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:07.550489 (+ 1208us) server_negotiation.cc:407] Connection header received
0811 18:58:07.552533 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:07.552539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:07.552676 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:07.552807 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:07.554547 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.555346 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.556969 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.557420 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.557567 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.561510 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:07.561516 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:07.561520 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:07.561554 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:07.564263 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.565058 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.565064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.565069 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.565206 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:07.565671 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:07.565679 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:07.565686 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:07.566040 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:07.566207 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:07.566943 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 18:58:07.567207 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:58:07.568786 14462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:07.549555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:35875)
0811 18:58:07.550320 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:07.550365 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:07.552249 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:07.553057 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:07.553065 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:07.553659 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:07.554355 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.554375 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.555545 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.555549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.556812 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:07.556825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:07.557693 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:07.557704 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:07.557946 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:07.558685 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:07.558711 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:07.561260 (+ 2549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:07.564451 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.564462 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.564482 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.564923 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.565338 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:07.565343 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:07.565347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:07.565544 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:07.566186 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:07.566194 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:07.566554 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 18:58:07.566840 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 18:58:07.567501 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":294,"threads_started":1}
I20260811 18:58:07.570506 14458 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:58:07.570844 14458 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:07.571655 14458 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:58:07.573339 13944 ts_manager.cc:194] Registered new tserver with Master: 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127)
I20260811 18:58:07.574201 13944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:35875
W20260811 18:58:07.918740 14463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:07.919118 14463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:07.919298 14463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:07.926635 14463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:07.926746 14463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:07.926965 14463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:58:07.937041 14463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:37675
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=42835
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:07.938480 14463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:07.939926 14463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:07.953925 14471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.954020 14476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:07.954035 14473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:07.954977 14463 server_base.cc:1034] running on GCE node
I20260811 18:58:07.955735 14463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:07.956804 14463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:07.958084 14463 hybrid_clock.cc:648] HybridClock initialized: now 1786474687958035 us; error 42 us; skew 500 ppm
I20260811 18:58:07.958467 14463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:07 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:07.962025 14463 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:58:07.963734 14463 webserver.cc:460] Webserver started at http://127.19.155.195:42835/ using document root <none> and password file <none>
I20260811 18:58:07.964478 14463 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:07.964658 14463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:07.971078 14463 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 18:58:07.974200 14489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:07.975806 14463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:07.976024 14463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "94aa4ea31652491b87f10f85a457110f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "d4134b343cfc7ab63f480c39964e091b"
server_key_iv: "be2c97b5205d987d3522cfe97b581d6a"
server_key_version: "encryptionkey@0"
I20260811 18:58:07.977104 14463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:08.000922 14463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:08.006145 14463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:08.006516 14463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:08.007700 14463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:08.009419 14463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:08.009555 14463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:08.009708 14463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:08.009815 14463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:08.046689 14463 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:37675
I20260811 18:58:08.046746 14676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:37675 every 8 connection(s)
I20260811 18:58:08.048389 14463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:08.049608 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 14463
Aug 11 18:58:08 dist-test-slave-1nl6 krb5kdc[13044](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474687, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:08.067849 14247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.050835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.19.155.254:44723)
0811 18:58:08.051106 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.051117 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.051617 (+ 500us) server_negotiation.cc:407] Connection header received
0811 18:58:08.051870 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.051879 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.051991 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.052158 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.054288 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.055466 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.056972 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.057618 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.057780 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.060976 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.060982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.060990 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.061029 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.064499 (+ 3470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.065346 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.065351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.065354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.065501 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.065967 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.065974 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.065982 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.066380 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.066662 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.067155 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.067444 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 18:58:08.072940 14681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.051606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:34361 (local address 127.19.155.254:44723)
0811 18:58:08.052642 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.052646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.053377 (+ 731us) server_negotiation.cc:407] Connection header received
0811 18:58:08.055860 (+ 2483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.055865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.055948 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.056077 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.058103 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.059302 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.060919 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.061431 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.061528 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.065700 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.065705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.065709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.065741 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.069257 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.070395 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.070401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.070404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.070558 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.071072 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.071076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.071079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.071489 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.071619 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.072464 (+ 845us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.072647 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":946,"thread_start_us":826,"threads_started":1}
I20260811 18:58:08.073993 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.052299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:34361)
0811 18:58:08.053208 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.053259 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.055554 (+ 2295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.056369 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.056378 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.056990 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:08.057846 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.057880 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.059477 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.059481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.060756 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.060769 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.061703 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.061716 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.062025 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.062665 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:08.062710 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:08.065442 (+ 2732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:08.069493 (+ 4051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:08.069510 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:08.069527 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:08.070265 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:08.070687 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:08.070690 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:08.070693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:08.070937 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:08.071645 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:08.071655 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:08.072044 (+ 389us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.072322 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.072758 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":367,"threads_started":1}
I20260811 18:58:08.075623 14677 heartbeater.cc:347] Connected to a master server at 127.19.155.254:44723
I20260811 18:58:08.075986 14677 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:08.076817 14677 heartbeater.cc:511] Master 127.19.155.254:44723 requested a full tablet report, sending...
I20260811 18:58:08.078541 13944 ts_manager.cc:194] Registered new tserver with Master: 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675)
I20260811 18:58:08.079474 13944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:34361
I20260811 18:58:08.079903 14243 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
I20260811 18:58:08.084371 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:08.094288 14681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.085517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44364 (local address 127.19.155.254:44723)
0811 18:58:08.085709 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.085715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.086113 (+ 398us) server_negotiation.cc:407] Connection header received
0811 18:58:08.086392 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.086397 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.086585 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.086742 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:08.087297 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.088069 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.089625 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.090062 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.090165 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.093251 (+ 3086us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:08.093616 (+ 365us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 18:58:08.094052 (+ 436us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44364: token expired
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 18:58:08.094455 14681 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44364: token expired
W20260811 18:58:08.095155 13829 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.155.254:44723)
I20260811 18:58:08.109797 14681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.095806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44372 (local address 127.19.155.254:44723)
0811 18:58:08.095996 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.096002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.096021 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:58:08.096229 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.096238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.096304 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.096413 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.097981 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.098778 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.100204 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.100654 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.100809 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.103838 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.103844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.103847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.103889 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.106516 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.107469 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.107477 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.107481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.107673 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.108121 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.108125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.108128 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.108517 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.108832 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.109177 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.109449 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 18:58:08.113840 13944 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:08.122248 13944 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:08.155761 14694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.136610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39876 (local address 127.19.155.193:35795)
0811 18:58:08.144400 (+ 7790us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.144415 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.144463 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:58:08.144623 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.144636 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.145036 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.145317 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:08.146758 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.149055 (+ 2297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.152614 (+ 3559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.154314 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.154534 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.154757 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.155189 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.155372 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7524,"thread_start_us":7315,"threads_started":1}
I20260811 18:58:08.155929 14693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.136308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39876)
0811 18:58:08.137625 (+ 1317us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.137664 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.137851 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.145811 (+ 7960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.145829 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.145904 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:08.146385 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.146401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.149346 (+ 2945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.149352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.152397 (+ 3045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.152421 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.154577 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.154583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.154849 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.154960 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.155136 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.155382 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":23,"thread_start_us":925,"threads_started":1}
I20260811 18:58:08.159520 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.146425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:44127 (local address 127.0.0.1:60580)
0811 18:58:08.147356 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.147377 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.147502 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.151503 (+ 4001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.151508 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.151540 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:08.152062 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.152086 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.154060 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.154066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.156367 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.156386 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.158596 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.158602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.158768 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.158802 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.158921 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.159081 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":5,"thread_start_us":1912,"threads_started":1}
I20260811 18:58:08.160346 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.146476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.19.155.194:44127)
0811 18:58:08.150740 (+ 4264us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.150750 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.150784 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:58:08.150928 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.150938 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.151261 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.151487 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:08.152340 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.153877 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.156558 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.158070 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.158257 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.158435 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.159814 (+ 1379us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.159993 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4080,"thread_start_us":3935,"threads_started":1}
I20260811 18:58:08.160881 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.136930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:37675 (local address 127.0.0.1:36736)
0811 18:58:08.144744 (+ 7814us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.144770 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.144948 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.151957 (+ 7009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.151963 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.151993 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:08.152553 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.152566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.154949 (+ 2383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.154954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.157358 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.157371 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.160122 (+ 2751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.160129 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.160298 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.160344 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.160450 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.160595 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7639,"mutex_wait_us":25,"thread_start_us":8646,"threads_started":1}
I20260811 18:58:08.160652 14146 tablet_service.cc:1467] Processing CreateTablet for tablet ad325f04326142d5bb082ce3f18ed7fd (DEFAULT_TABLE table=test-table [id=1c82a309da454e218f5389c75703ad78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:08.161345 14697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.138736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36736 (local address 127.19.155.195:37675)
0811 18:58:08.151331 (+ 12595us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.151338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.151365 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:08.151485 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.151492 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.151729 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.151950 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:08.152760 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.154795 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.157580 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.159575 (+ 1995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.159798 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.159970 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.160801 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.160986 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12423,"thread_start_us":12217,"threads_started":1}
I20260811 18:58:08.162326 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad325f04326142d5bb082ce3f18ed7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:08.166857 14566 tablet_service.cc:1467] Processing CreateTablet for tablet ad325f04326142d5bb082ce3f18ed7fd (DEFAULT_TABLE table=test-table [id=1c82a309da454e218f5389c75703ad78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:08.166875 14352 tablet_service.cc:1467] Processing CreateTablet for tablet ad325f04326142d5bb082ce3f18ed7fd (DEFAULT_TABLE table=test-table [id=1c82a309da454e218f5389c75703ad78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:08.168342 14566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad325f04326142d5bb082ce3f18ed7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:08.168401 14352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad325f04326142d5bb082ce3f18ed7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:08.181034 14700 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Bootstrap starting.
I20260811 18:58:08.183583 14701 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Bootstrap starting.
I20260811 18:58:08.185191 14700 tablet_bootstrap.cc:654] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:08.186959 14700 log.cc:824] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:08.188562 14701 tablet_bootstrap.cc:654] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:08.189998 14701 log.cc:824] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:08.190531 14700 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: No bootstrap required, opened a new log
I20260811 18:58:08.190840 14700 ts_tablet_manager.cc:1397] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 18:58:08.191082 14703 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Bootstrap starting.
I20260811 18:58:08.193727 14701 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: No bootstrap required, opened a new log
I20260811 18:58:08.194051 14701 ts_tablet_manager.cc:1397] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260811 18:58:08.194458 14703 tablet_bootstrap.cc:654] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:08.195765 14703 log.cc:824] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:08.199129 14703 tablet_bootstrap.cc:492] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: No bootstrap required, opened a new log
I20260811 18:58:08.199451 14703 ts_tablet_manager.cc:1397] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s
I20260811 18:58:08.202204 14700 raft_consensus.cc:348] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.202713 14700 raft_consensus.cc:374] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:08.202870 14700 raft_consensus.cc:729] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21adfc746bbe401c994f6d4329208374, State: Initialized, Role: FOLLOWER
I20260811 18:58:08.203593 14700 consensus_queue.cc:260] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.205602 14700 ts_tablet_manager.cc:1428] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
I20260811 18:58:08.205976 14701 raft_consensus.cc:348] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.206564 14701 raft_consensus.cc:374] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:08.206698 14701 raft_consensus.cc:729] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94aa4ea31652491b87f10f85a457110f, State: Initialized, Role: FOLLOWER
I20260811 18:58:08.207443 14701 consensus_queue.cc:260] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.208698 14677 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
I20260811 18:58:08.208847 14703 raft_consensus.cc:348] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.209322 14703 raft_consensus.cc:374] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:08.209424 14703 raft_consensus.cc:729] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dd99cabac354b60bec0c63ef6b5248f, State: Initialized, Role: FOLLOWER
I20260811 18:58:08.209450 14701 ts_tablet_manager.cc:1428] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 18:58:08.210161 14703 consensus_queue.cc:260] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.211822 14458 heartbeater.cc:503] Master 127.19.155.254:44723 was elected leader, sending a full tablet report...
I20260811 18:58:08.212798 14703 ts_tablet_manager.cc:1428] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260811 18:58:08.290582 14245 tablet.cc:2369] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:08.295739 14715 raft_consensus.cc:482] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:08.296120 14715 raft_consensus.cc:504] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.298077 14715 leader_election.cc:288] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795), 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675)
W20260811 18:58:08.298543 14461 tablet.cc:2369] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:08.300204 14678 tablet.cc:2369] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:08.306488 14694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.298729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37095 (local address 127.19.155.193:35795)
0811 18:58:08.298999 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.299004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.300317 (+ 1313us) server_negotiation.cc:407] Connection header received
0811 18:58:08.300532 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.300536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.300646 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.300778 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:08.301493 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.302569 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.304598 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.305428 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.305639 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.305743 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.306057 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.306202 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:58:08.306553 14697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.298721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:58895 (local address 127.19.155.195:37675)
0811 18:58:08.299009 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.299014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.300623 (+ 1609us) server_negotiation.cc:407] Connection header received
0811 18:58:08.300876 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.300885 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.300968 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.301045 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:08.301969 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.302836 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.304691 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.305513 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.305719 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.305804 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.306128 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.306283 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:58:08.306686 14719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.299115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.19.155.194:37095)
0811 18:58:08.300161 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.300179 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.300332 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.300865 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.300870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.300899 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:08.301285 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.301299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.302713 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.302721 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.304397 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.304411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.305702 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.305709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.305876 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.305905 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.306024 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.306202 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":1,"thread_start_us":706,"threads_started":1}
I20260811 18:58:08.306738 14718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.298517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:37675 (local address 127.19.155.194:58895)
0811 18:58:08.299893 (+ 1376us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.300504 (+ 611us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:08.300679 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:08.301338 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:08.301341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:08.301365 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:08.301792 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.301807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.303024 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.303030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.304508 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:08.304522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.305765 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.305772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:08.305958 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.305982 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 18:58:08.306096 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:58:08.306274 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1141,"mutex_wait_us":28,"thread_start_us":877,"threads_started":1}
I20260811 18:58:08.308095 14596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad325f04326142d5bb082ce3f18ed7fd" candidate_uuid: "0dd99cabac354b60bec0c63ef6b5248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94aa4ea31652491b87f10f85a457110f" is_pre_election: true
I20260811 18:58:08.308095 14173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad325f04326142d5bb082ce3f18ed7fd" candidate_uuid: "0dd99cabac354b60bec0c63ef6b5248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21adfc746bbe401c994f6d4329208374" is_pre_election: true
I20260811 18:58:08.308784 14596 raft_consensus.cc:2454] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dd99cabac354b60bec0c63ef6b5248f in term 0.
I20260811 18:58:08.308769 14173 raft_consensus.cc:2454] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dd99cabac354b60bec0c63ef6b5248f in term 0.
I20260811 18:58:08.309564 14282 leader_election.cc:302] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0dd99cabac354b60bec0c63ef6b5248f, 21adfc746bbe401c994f6d4329208374, 94aa4ea31652491b87f10f85a457110f; no voters:
I20260811 18:58:08.310034 14715 raft_consensus.cc:2781] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:08.310211 14715 raft_consensus.cc:482] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:08.310340 14715 raft_consensus.cc:3037] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:08.312834 14715 raft_consensus.cc:504] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.313637 14715 leader_election.cc:288] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [CANDIDATE]: Term 1 election: Requested vote from peers 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795), 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675)
I20260811 18:58:08.314226 14173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad325f04326142d5bb082ce3f18ed7fd" candidate_uuid: "0dd99cabac354b60bec0c63ef6b5248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21adfc746bbe401c994f6d4329208374"
I20260811 18:58:08.314250 14596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad325f04326142d5bb082ce3f18ed7fd" candidate_uuid: "0dd99cabac354b60bec0c63ef6b5248f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94aa4ea31652491b87f10f85a457110f"
I20260811 18:58:08.314488 14173 raft_consensus.cc:3037] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:08.314487 14596 raft_consensus.cc:3037] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:08.317974 14596 raft_consensus.cc:2454] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dd99cabac354b60bec0c63ef6b5248f in term 1.
I20260811 18:58:08.317973 14173 raft_consensus.cc:2454] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dd99cabac354b60bec0c63ef6b5248f in term 1.
I20260811 18:58:08.318651 14281 leader_election.cc:302] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0dd99cabac354b60bec0c63ef6b5248f, 21adfc746bbe401c994f6d4329208374, 94aa4ea31652491b87f10f85a457110f; no voters:
I20260811 18:58:08.319058 14715 raft_consensus.cc:2781] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:08.319538 14715 raft_consensus.cc:686] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 1 LEADER]: Becoming Leader. State: Replica: 0dd99cabac354b60bec0c63ef6b5248f, State: Running, Role: LEADER
I20260811 18:58:08.320078 14715 consensus_queue.cc:237] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } }
I20260811 18:58:08.325449 13944 catalog_manager.cc:5495] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194). New cstate: current_term: 1 leader_uuid: "0dd99cabac354b60bec0c63ef6b5248f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dd99cabac354b60bec0c63ef6b5248f" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 44127 } health_report { overall_health: HEALTHY } } }
I20260811 18:58:08.352927 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.347112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60594 (local address 127.19.155.194:44127)
0811 18:58:08.347358 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.347363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.347383 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:58:08.347478 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.347481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.347573 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.347717 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:08.348101 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.348865 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.350618 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.351140 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.351249 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.351825 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:08.352393 (+ 568us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:08.352558 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.352624 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.352703 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 18:58:08.362272 14173 raft_consensus.cc:1261] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Refusing update from remote peer 0dd99cabac354b60bec0c63ef6b5248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:08.362272 14596 raft_consensus.cc:1261] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Refusing update from remote peer 0dd99cabac354b60bec0c63ef6b5248f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:08.363761 14715 consensus_queue.cc:1035] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94aa4ea31652491b87f10f85a457110f" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:08.364151 14720 consensus_queue.cc:1035] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21adfc746bbe401c994f6d4329208374" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:08.379240 14723 mvcc.cc:205] Tried to move back new op lower bound from 7317400323519328256 to 7317400323363360768. Current Snapshot: MvccSnapshot[applied={T|T < 7317400323519328256}]
I20260811 18:58:08.393229 13941 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:08.393625 13941 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:08.398034 13941 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Sending DeleteTablet for 3 replicas of tablet ad325f04326142d5bb082ce3f18ed7fd
I20260811 18:58:08.399639 14566 tablet_service.cc:1514] Processing DeleteTablet for tablet ad325f04326142d5bb082ce3f18ed7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:08 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:36736
I20260811 18:58:08.399626 14146 tablet_service.cc:1514] Processing DeleteTablet for tablet ad325f04326142d5bb082ce3f18ed7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:08 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39876
I20260811 18:58:08.399849 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 14007
I20260811 18:58:08.401716 14352 tablet_service.cc:1514] Processing DeleteTablet for tablet ad325f04326142d5bb082ce3f18ed7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:08 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:60580
I20260811 18:58:08.402374 14735 tablet_replica.cc:330] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: stopping tablet replica
I20260811 18:58:08.402894 14735 raft_consensus.cc:2229] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:08.403496 14735 raft_consensus.cc:2258] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:08.406054 14736 tablet_replica.cc:330] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: stopping tablet replica
I20260811 18:58:08.406649 14736 raft_consensus.cc:2229] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:08.407346 14736 raft_consensus.cc:2258] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:08.409839 14736 ts_tablet_manager.cc:1905] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:08.410211 14735 ts_tablet_manager.cc:1905] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:08.415933 14737 tablet_replica.cc:330] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: stopping tablet replica
I20260811 18:58:08.416702 14737 raft_consensus.cc:2229] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:08.417611 14737 raft_consensus.cc:2258] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:08.419358 14736 ts_tablet_manager.cc:1918] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:08.419574 14736 log.cc:1196] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/ad325f04326142d5bb082ce3f18ed7fd
I20260811 18:58:08.420301 14736 ts_tablet_manager.cc:1939] T ad325f04326142d5bb082ce3f18ed7fd P 94aa4ea31652491b87f10f85a457110f: Deleting consensus metadata
I20260811 18:58:08.421105 14737 ts_tablet_manager.cc:1905] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:08.421727 14694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.401158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.19.155.193:35795)
0811 18:58:08.401348 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.401354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.401375 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:58:08.401439 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.401446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.401542 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.401649 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.404657 (+ 3008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.405877 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.408933 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.409605 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.409784 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.413683 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.413704 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.413724 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.413790 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.418112 (+ 4322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.419059 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.419074 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.419079 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.419268 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.419793 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.419799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.419802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.420403 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.420743 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.421074 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.421315 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:58:08.422521 13915 catalog_manager.cc:4841] TS 94aa4ea31652491b87f10f85a457110f (127.19.155.195:37675): tablet ad325f04326142d5bb082ce3f18ed7fd (table test-table [id=1c82a309da454e218f5389c75703ad78]) successfully deleted
I20260811 18:58:08.422797 14238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:08.429795 14737 ts_tablet_manager.cc:1918] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:08.430058 14737 log.cc:1196] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/ad325f04326142d5bb082ce3f18ed7fd
I20260811 18:58:08.430609 14737 ts_tablet_manager.cc:1939] T ad325f04326142d5bb082ce3f18ed7fd P 0dd99cabac354b60bec0c63ef6b5248f: Deleting consensus metadata
I20260811 18:58:08.432533 13915 catalog_manager.cc:4841] TS 0dd99cabac354b60bec0c63ef6b5248f (127.19.155.194:44127): tablet ad325f04326142d5bb082ce3f18ed7fd (table test-table [id=1c82a309da454e218f5389c75703ad78]) successfully deleted
I20260811 18:58:08.539954 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 14007
W20260811 18:58:08.574715 13916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.155.193:35795 (error 108)
I20260811 18:58:08.576030 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 14249
I20260811 18:58:08.577818 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.576987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39902)
0811 18:58:08.577579 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.577673 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490}
W20260811 18:58:08.578466 13916 catalog_manager.cc:4584] TS 21adfc746bbe401c994f6d4329208374 (127.19.155.193:35795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad325f04326142d5bb082ce3f18ed7fd: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
I20260811 18:58:08.593894 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.578218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.19.155.194:44127)
0811 18:58:08.578403 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.578409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.578430 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:58:08.578506 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.578511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.578627 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.578745 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.580618 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.581571 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.583267 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.583812 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.583979 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.586949 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.586968 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.586995 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.587044 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.590375 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.591457 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.591466 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.591468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.591631 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.592088 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.592092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.592094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.592519 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.592887 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.593242 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.593514 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:58:08.594798 14449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:08.632308 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.631676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39916)
0811 18:58:08.631944 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.632077 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 18:58:08.633561 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.633127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39920)
0811 18:58:08.633311 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.633417 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 18:58:08.694495 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.693889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39932)
0811 18:58:08.694171 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.694296 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 18:58:08.695822 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.695390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39934)
0811 18:58:08.695566 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.695658 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 18:58:08.711066 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 14249
I20260811 18:58:08.739732 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 14463
I20260811 18:58:08.754740 14697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.740548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36752 (local address 127.19.155.195:37675)
0811 18:58:08.740753 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:08.740759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:08.740851 (+ 92us) server_negotiation.cc:407] Connection header received
0811 18:58:08.741067 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:08.741077 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:08.741144 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:08.741267 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:08.742710 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.743537 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.744900 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:08.745316 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:08.745466 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:08.748695 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:08.748712 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:08.748730 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:08.748770 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:08.751813 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.752685 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.752693 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.752695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.752843 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:08.753240 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:08.753244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:08.753247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:08.753648 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:08.753907 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:08.754154 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 18:58:08.754339 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:58:08.755514 14671 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:08.777283 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.776718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39942)
0811 18:58:08.776976 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.777083 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 18:58:08.778515 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:08.778089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39952)
0811 18:58:08.778313 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:08.778388 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 18:58:08.849642 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 14463
I20260811 18:58:08.882608 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 13890
I20260811 18:58:08.884018 13993 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:09.002733 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 13890
I20260811 18:58:09.002792 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:09.002112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35795 (local address 127.0.0.1:39958)
0811 18:58:09.002420 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:09.002535 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 18:58:29.038420 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--webserver_interface=127.19.155.254
--webserver_port=33615
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:29.431129 14745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:29.431500 14745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:29.431676 14745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:29.439575 14745 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:58:29.439703 14745 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:58:29.439776 14745 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:58:29.439854 14745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:29.439936 14745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:29.440056 14745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:29.440131 14745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:29.440212 14745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:29.451478 14745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=33615
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:29.453001 14745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:29.454556 14745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:29.468210 14753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:29.468238 14752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:29.468281 14756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:29.469247 14745 server_base.cc:1034] running on GCE node
I20260811 18:58:29.470239 14745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:29.471987 14745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:29.473273 14745 hybrid_clock.cc:648] HybridClock initialized: now 1786474709473202 us; error 48 us; skew 500 ppm
I20260811 18:58:29.473658 14745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:29 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:29.482209 14745 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:58:29.484141 14745 webserver.cc:460] Webserver started at http://127.19.155.254:33615/ using document root <none> and password file <none>
I20260811 18:58:29.484984 14745 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:29.485137 14745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:29.491601 14745 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 18:58:29.495189 14772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:29.496759 14745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:58:29.497008 14745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "14ddf90850474e39ab2b9e943d4849ad"
format_stamp: "Formatted at 2026-08-11 18:57:42 on dist-test-slave-1nl6"
server_key: "cd72605ea5c79831b39a5200e9a3c1b2"
server_key_iv: "6ab639668c41216cf3d050637246f6ca"
server_key_version: "encryptionkey@0"
I20260811 18:58:29.498160 14745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:29.513825 14745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:29.519482 14745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:29.519841 14745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:29.541644 14745 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44723
I20260811 18:58:29.541692 14854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44723 every 8 connection(s)
I20260811 18:58:29.543540 14745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:29.548396 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 14745
I20260811 18:58:29.549374 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:35795
--local_ip_for_outbound_sockets=127.19.155.193
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=42201
--webserver_interface=127.19.155.193
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:58:29.551808 14855 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:58:29.555640 14855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap starting.
I20260811 18:58:29.578536 14855 log.cc:824] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:29.596856 14855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:58:29.597548 14855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Bootstrap complete.
I20260811 18:58:29.608224 14855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:29.609310 14855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Initialized, Role: FOLLOWER
I20260811 18:58:29.610029 14855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:29.610327 14855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:29.610473 14855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:29.610673 14855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:58:29.615202 14855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:29.615886 14855 leader_election.cc:302] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14ddf90850474e39ab2b9e943d4849ad; no voters:
I20260811 18:58:29.616709 14855 leader_election.cc:288] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:58:29.616886 14861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:58:29.618204 14861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [term 3 LEADER]: Becoming Leader. State: Replica: 14ddf90850474e39ab2b9e943d4849ad, State: Running, Role: LEADER
I20260811 18:58:29.619019 14861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } }
I20260811 18:58:29.619426 14855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:29.622021 14870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14ddf90850474e39ab2b9e943d4849ad. Latest consensus state: current_term: 3 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:58:29.622054 14863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "14ddf90850474e39ab2b9e943d4849ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14ddf90850474e39ab2b9e943d4849ad" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44723 } } }
I20260811 18:58:29.622486 14870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:29.622540 14863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:29.633201 14881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:29.646126 14881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:29.649360 14881 catalog_manager.cc:1259] Loaded cluster ID: f833e3f230144d4d85b234c83ea534c7
I20260811 18:58:29.649664 14881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:29.654937 14896 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:58:29.655565 14881 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:29.657361 14881 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Loaded TSK: 0
I20260811 18:58:29.657536 14881 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 14ddf90850474e39ab2b9e943d4849ad: Loaded TSK: 1
F20260811 18:58:29.658529 14881 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f840de929ad google::LogMessage::Fail() at ??:0
@ 0x7f840de9588a google::LogMessage::SendToLog() at ??:0
@ 0x7f840de924de google::LogMessage::Flush() at ??:0
@ 0x7f840de93a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8411bf67d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8411be573e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f84238c11c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f84238c0783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f842394c2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f842394c0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f84239965e9 std::function<>::operator()() at ??:0
@ 0x7f84238c4cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f84238c2c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f842394a610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f842394a439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8410ade345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8410ae191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8410ae1799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8410abceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8413d966db start_thread at ??:0
@ 0x7f840cd2c61f clone at ??:0
W20260811 18:58:30.040549 14859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:30.040894 14859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:30.040994 14859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:30.048820 14859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:30.048967 14859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:30.049086 14859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:58:30.059829 14859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:35795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=42201
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:30.061265 14859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:30.062652 14859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:30.077481 14946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:30.077558 14949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:30.077522 14945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:30.078703 14859 server_base.cc:1034] running on GCE node
I20260811 18:58:30.079422 14859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:30.080422 14859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:30.081626 14859 hybrid_clock.cc:648] HybridClock initialized: now 1786474710081575 us; error 34 us; skew 500 ppm
I20260811 18:58:30.081962 14859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:30 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474710, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:30.085431 14859 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:58:30.087212 14859 webserver.cc:460] Webserver started at http://127.19.155.193:42201/ using document root <none> and password file <none>
I20260811 18:58:30.087996 14859 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:30.088146 14859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:30.094405 14859 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 18:58:30.098065 14963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:30.099686 14859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:30.099905 14859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "21adfc746bbe401c994f6d4329208374"
format_stamp: "Formatted at 2026-08-11 18:57:43 on dist-test-slave-1nl6"
server_key: "22ce74aca7d5ede50c6592364d585be9"
server_key_iv: "c5a527d45540dadeb59928362d3860f9"
server_key_version: "encryptionkey@0"
I20260811 18:58:30.100999 14859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:30.123641 14859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:30.128329 14859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:30.128666 14859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:30.129823 14859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:30.131976 14972 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260811 18:58:30.138229 14972 ts_tablet_manager.cc:1852] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260811 18:58:30.140177 14972 ts_tablet_manager.cc:1905] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:30.151237 14972 ts_tablet_manager.cc:1918] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:30.151473 14972 log.cc:1196] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/ad325f04326142d5bb082ce3f18ed7fd
I20260811 18:58:30.151968 14972 ts_tablet_manager.cc:1939] T ad325f04326142d5bb082ce3f18ed7fd P 21adfc746bbe401c994f6d4329208374: Deleting consensus metadata
I20260811 18:58:30.152418 14859 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260811 18:58:30.152582 14859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.021s user 0.000s sys 0.001s
I20260811 18:58:30.152742 14859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:30.152839 14859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:30.189873 14859 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35795
I20260811 18:58:30.189934 15139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35795 every 8 connection(s)
I20260811 18:58:30.191416 14859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:30.194651 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 14859
I20260811 18:58:30.195544 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:44127
--local_ip_for_outbound_sockets=127.19.155.194
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=45209
--webserver_interface=127.19.155.194
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:58:30.197486 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.194793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:32905)
0811 18:58:30.195837 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.196154 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":353,"threads_started":1}
W20260811 18:58:30.198292 15141 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:44723 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:44723: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
I20260811 18:58:30.199532 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.198995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:40969)
0811 18:58:30.199218 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.199325 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 18:58:30.200798 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.200281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:52739)
0811 18:58:30.200480 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.200594 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 18:58:30.201112 15141 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:58:30.569499 15150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:30.569824 15150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:30.570021 15150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:30.577800 15150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:30.577965 15150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:30.578171 15150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:58:30.588907 15150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:44127
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=45209
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:30.590339 15150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:30.591818 15150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:30.606199 15158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:30.606390 15162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:30.606258 15160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:30.607440 15150 server_base.cc:1034] running on GCE node
I20260811 18:58:30.608208 15150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:30.609366 15150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:30.610618 15150 hybrid_clock.cc:648] HybridClock initialized: now 1786474710610558 us; error 57 us; skew 500 ppm
I20260811 18:58:30.611052 15150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:30 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474710, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:30.614629 15150 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:58:30.616382 15150 webserver.cc:460] Webserver started at http://127.19.155.194:45209/ using document root <none> and password file <none>
I20260811 18:58:30.617199 15150 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:30.617365 15150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:30.623421 15150 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 18:58:30.626487 15177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:30.628121 15150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:30.628342 15150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "0dd99cabac354b60bec0c63ef6b5248f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "584470e8503784cd6513ed4ee99cb6a5"
server_key_iv: "ad9505abe9021615f5be7d3692033c72"
server_key_version: "encryptionkey@0"
I20260811 18:58:30.629449 15150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:30.655014 15150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:30.659979 15150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:30.660295 15150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:30.661439 15150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:30.663467 15150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:30.663619 15150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:30.663746 15150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:30.663823 15150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:30.699829 15150 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:44127
I20260811 18:58:30.699937 15365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:44127 every 8 connection(s)
I20260811 18:58:30.701588 15150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:30.707037 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.704824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:42345)
0811 18:58:30.705740 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.706015 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":415,"threads_started":1}
W20260811 18:58:30.707683 15367 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:44723 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:44723: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
I20260811 18:58:30.708494 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.708179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:33169)
0811 18:58:30.708319 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.708389 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 18:58:30.709385 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:30.709036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:47121)
0811 18:58:30.709190 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:30.709272 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 18:58:30.709618 15367 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:58:30.711546 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 15150
I20260811 18:58:30.712241 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:37675
--local_ip_for_outbound_sockets=127.19.155.195
--tserver_master_addrs=127.19.155.254:44723
--webserver_port=42835
--webserver_interface=127.19.155.195
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:31.090811 15370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:31.091292 15370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:31.091473 15370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:31.099390 15370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:31.099531 15370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:31.099738 15370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:58:31.110455 15370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:37675
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=42835
--tserver_master_addrs=127.19.155.254:44723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:31.111995 15370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:31.113467 15370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:31.128567 15378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:31.128615 15377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:31.128659 15381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:31.129592 15370 server_base.cc:1034] running on GCE node
I20260811 18:58:31.130400 15370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:31.131647 15370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:31.132905 15370 hybrid_clock.cc:648] HybridClock initialized: now 1786474711132849 us; error 62 us; skew 500 ppm
I20260811 18:58:31.133282 15370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:31 dist-test-slave-1nl6 krb5kdc[13044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474711, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:31.136991 15370 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:58:31.138814 15370 webserver.cc:460] Webserver started at http://127.19.155.195:42835/ using document root <none> and password file <none>
I20260811 18:58:31.139804 15370 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:31.140000 15370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:31.146531 15370 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 18:58:31.149713 15395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:31.151317 15370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:58:31.151537 15370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "94aa4ea31652491b87f10f85a457110f"
format_stamp: "Formatted at 2026-08-11 18:57:44 on dist-test-slave-1nl6"
server_key: "d4134b343cfc7ab63f480c39964e091b"
server_key_iv: "be2c97b5205d987d3522cfe97b581d6a"
server_key_version: "encryptionkey@0"
I20260811 18:58:31.152647 15370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:31.171686 15370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:31.176659 15370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:31.177000 15370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:31.178122 15370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:31.179677 15370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:31.179816 15370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:31.179970 15370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:31.180059 15370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:31.203665 15499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.201944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:43553)
0811 18:58:31.203197 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.203386 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1109,"thread_start_us":996,"threads_started":1}
I20260811 18:58:31.217914 15370 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:37675
I20260811 18:58:31.217978 15578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:37675 every 8 connection(s)
I20260811 18:58:31.219696 15370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:31.225068 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.223044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:46717)
0811 18:58:31.223887 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.224143 (+ 256us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":333,"threads_started":1}
W20260811 18:58:31.225916 15579 heartbeater.cc:644] Failed to heartbeat to 127.19.155.254:44723 (0 consecutive failures): Network error: Failed to ping master at 127.19.155.254:44723: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
I20260811 18:58:31.226819 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.226462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:46645)
0811 18:58:31.226623 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.226699 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:58:31.227735 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 15370
I20260811 18:58:31.227763 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.227442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:55885)
0811 18:58:31.227577 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.227653 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:58:31.228113 15579 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:58:31.711205 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:31.710229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:48411)
0811 18:58:31.710754 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:31.710852 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":263,"threads_started":1}
I20260811 18:58:32.205672 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.204873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:38255)
0811 18:58:32.205389 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.205480 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":264,"threads_started":1}
I20260811 18:58:32.229828 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.228808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:43385)
0811 18:58:32.229407 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.229550 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":305,"threads_started":1}
I20260811 18:58:32.713117 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:32.712285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:46213)
0811 18:58:32.712828 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:32.712928 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":270,"threads_started":1}
I20260811 18:58:33.207499 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.206642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:59281)
0811 18:58:33.207210 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.207301 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":339,"threads_started":1}
I20260811 18:58:33.231717 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.230884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:45329)
0811 18:58:33.231447 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.231535 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":242,"threads_started":1}
I20260811 18:58:33.715113 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:33.714177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:34165)
0811 18:58:33.714725 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:33.714835 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":286,"threads_started":1}
I20260811 18:58:34.209298 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.208514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:52111)
0811 18:58:34.209017 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.209115 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":262,"threads_started":1}
I20260811 18:58:34.233680 15605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.232778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:48317)
0811 18:58:34.233389 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.233492 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":286,"threads_started":1}
I20260811 18:58:34.717162 15606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:34.716240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:52337)
0811 18:58:34.716817 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:34.716930 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":272,"threads_started":1}
I20260811 18:58:35.211345 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.210428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:43833)
0811 18:58:35.210952 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.211074 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":231,"threads_started":1}
I20260811 18:58:35.235654 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.234736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:40911)
0811 18:58:35.235367 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.235465 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":351,"threads_started":1}
I20260811 18:58:35.719411 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:35.718353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:54043)
0811 18:58:35.719101 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:35.719206 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":298,"threads_started":1}
I20260811 18:58:36.213325 15613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.212478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:52261)
0811 18:58:36.213029 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.213134 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":287,"threads_started":1}
I20260811 18:58:36.237566 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.236723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:49929)
0811 18:58:36.237276 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.237379 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":277,"threads_started":1}
I20260811 18:58:36.721282 15616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:36.720461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:48247)
0811 18:58:36.721016 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:36.721111 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":305,"threads_started":1}
I20260811 18:58:37.215512 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.214375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:57639)
0811 18:58:37.215022 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.215113 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":266,"threads_started":1}
I20260811 18:58:37.239496 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.238619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:35655)
0811 18:58:37.239220 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.239322 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":348,"threads_started":1}
I20260811 18:58:37.723464 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:37.722451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:42097)
0811 18:58:37.723093 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:37.723209 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":308,"threads_started":1}
I20260811 18:58:38.217422 15621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:38.216564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:56253)
0811 18:58:38.217138 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:38.217236 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":315,"threads_started":1}
I20260811 18:58:38.241542 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:38.240586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:54623)
0811 18:58:38.241218 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:38.241308 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":322,"threads_started":1}
I20260811 18:58:38.725368 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:38.724550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:41443)
0811 18:58:38.725107 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:38.725194 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":329,"threads_started":1}
I20260811 18:58:39.219573 15625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.218641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:54331)
0811 18:58:39.219296 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.219403 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":353,"threads_started":1}
I20260811 18:58:39.243570 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.242661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:46363)
0811 18:58:39.243303 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.243397 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":367,"threads_started":1}
I20260811 18:58:39.727375 15629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:39.726461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:58351)
0811 18:58:39.727080 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:39.727176 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":276,"threads_started":1}
I20260811 18:58:40.221545 15630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.220675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:47169)
0811 18:58:40.221217 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.221322 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":267,"threads_started":1}
I20260811 18:58:40.245363 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.244555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:40311)
0811 18:58:40.245061 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.245172 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":245,"threads_started":1}
I20260811 18:58:40.729360 15634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:40.728556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:36875)
0811 18:58:40.729070 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:40.729168 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":269,"threads_started":1}
I20260811 18:58:41.223559 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:41.222716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:47625)
0811 18:58:41.223278 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:41.223367 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":340,"threads_started":1}
I20260811 18:58:41.247432 15636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:41.246576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:35009)
0811 18:58:41.247153 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:41.247252 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":261,"threads_started":1}
I20260811 18:58:41.731539 15638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:41.730613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:36159)
0811 18:58:41.731218 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:41.731343 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":339,"threads_started":1}
I20260811 18:58:42.225390 15640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:42.224604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:43971)
0811 18:58:42.225123 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:42.225220 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":265,"threads_started":1}
I20260811 18:58:42.249446 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:42.248560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:39815)
0811 18:58:42.249140 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:42.249251 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":322,"threads_started":1}
I20260811 18:58:42.733438 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:42.732673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:49375)
0811 18:58:42.733171 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:42.733265 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":244,"threads_started":1}
I20260811 18:58:43.227656 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:43.226705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:33533)
0811 18:58:43.227320 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:43.227436 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":331,"threads_started":1}
I20260811 18:58:43.251610 15646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:43.250616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:59181)
0811 18:58:43.251233 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:43.251377 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":337,"threads_started":1}
I20260811 18:58:43.735409 15647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:43.734546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:37321)
0811 18:58:43.735107 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:43.735212 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":243,"threads_started":1}
I20260811 18:58:44.229539 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:44.228742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:51841)
0811 18:58:44.229243 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:44.229350 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260811 18:58:44.253677 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:44.252774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:39709)
0811 18:58:44.253348 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:44.253459 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":265,"threads_started":1}
I20260811 18:58:44.737156 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:44.736409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:35565)
0811 18:58:44.736868 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:44.736969 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":227,"threads_started":1}
I20260811 18:58:45.231596 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:45.230764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:59435)
0811 18:58:45.231286 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:45.231407 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":291,"threads_started":1}
I20260811 18:58:45.255646 15653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:45.254765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:59525)
0811 18:58:45.255360 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:45.255459 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":344,"threads_started":1}
I20260811 18:58:45.739277 15654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:45.738416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.194:51783)
0811 18:58:45.738949 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:45.739091 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":252,"threads_started":1}
I20260811 18:58:46.229753 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 14859
I20260811 18:58:46.233672 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:46.232469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.193:39975)
0811 18:58:46.233099 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:46.233305 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":360,"threads_started":1}
I20260811 18:58:46.250867 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:46.231045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35452 (local address 127.19.155.193:35795)
0811 18:58:46.232010 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:46.232032 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:46.232091 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:58:46.234480 (+ 2389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:46.234513 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:46.235074 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:46.235396 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:46.236976 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.238300 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.239767 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.240700 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.240851 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:46.243937 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:46.243947 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:46.243966 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:46.244033 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:46.247386 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.248179 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.248187 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.248197 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.248390 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.248765 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.248769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.248771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.249390 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:46.249644 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:46.250136 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 18:58:46.250534 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":546,"threads_started":1}
I20260811 18:58:46.252429 15133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:46.257869 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:46.256910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:44723 (local address 127.19.155.195:35367)
0811 18:58:46.257548 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:46.257671 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.254:44723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":314,"threads_started":1}
I20260811 18:58:46.340632 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 14859
I20260811 18:58:46.375900 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 15150
I20260811 18:58:46.395449 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:46.376987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60980 (local address 127.19.155.194:44127)
0811 18:58:46.377559 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:46.377575 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:46.377614 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:58:46.379310 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:46.379321 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:46.379801 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:46.380120 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:46.381569 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.382864 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.384376 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.385134 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.385297 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:46.388317 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:46.388327 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:46.388347 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:46.388398 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:46.391838 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.392724 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.392732 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.392740 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.392945 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.393333 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.393336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.393339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.393954 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:46.394207 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:46.394656 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 18:58:46.395124 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":282,"threads_started":1}
I20260811 18:58:46.396975 15358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:46.484549 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 15150
I20260811 18:58:46.512271 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 15370
I20260811 18:58:46.532104 15668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:46.513362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54528 (local address 127.19.155.195:37675)
0811 18:58:46.514029 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:46.514045 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:46.514090 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:58:46.515900 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:46.515911 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:46.516394 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:46.516719 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:46.518235 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.519747 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.521529 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:46.522255 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:46.522416 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:46.525294 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:46.525304 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:46.525324 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:46.525371 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:46.528559 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.529319 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.529327 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.529335 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.529528 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:46.529971 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:46.529975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:46.529977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:46.530536 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:46.530789 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:46.531379 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 18:58:46.531781 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":325,"threads_started":1}
I20260811 18:58:46.533739 15572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:46.618603 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 15370
2026-08-11T18:58:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65855 ms)
[----------] 30 tests from SecurityITest (304580 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:46 dist-test-slave-1nl6 krb5kdc[15672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:46 dist-test-slave-1nl6 krb5kdc[15672](info): set up 2 sockets
Aug 11 18:58:46 dist-test-slave-1nl6 krb5kdc[15672](info): commencing operation
krb5kdc: starting...
W20260811 18:58:48.012506 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:58:48 dist-test-slave-1nl6 krb5kdc[15672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:58:48.376988 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40795
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:45309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:40795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:48.765911 15696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:48.766335 15696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:48.766521 15696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:48.774241 15696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:48.774451 15696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:48.774566 15696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:48.774678 15696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:48.774773 15696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:48.785296 15696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:45309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:40795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:48.787647 15696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:48.789171 15696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:48.805039 15703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:48.805087 15705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:48.805065 15708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:48.806383 15696 server_base.cc:1034] running on GCE node
I20260811 18:58:48.807593 15696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:48.809851 15696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:48.811139 15696 hybrid_clock.cc:648] HybridClock initialized: now 1786474728811066 us; error 52 us; skew 500 ppm
I20260811 18:58:48.811676 15696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:48 dist-test-slave-1nl6 krb5kdc[15672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:48.822654 15696 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:58:48.824872 15696 webserver.cc:460] Webserver started at http://127.19.155.254:40225/ using document root <none> and password file <none>
I20260811 18:58:48.825802 15696 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:48.825994 15696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:48.826377 15696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:48.829999 15696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "6962d523143644b5bfae3985f42382ee"
format_stamp: "Formatted at 2026-08-11 18:58:48 on dist-test-slave-1nl6"
server_key: "d681702a7e49d5202baf45b645c10f7f"
server_key_iv: "714ea719b45e4dbdb26942a653765ee8"
server_key_version: "encryptionkey@0"
I20260811 18:58:48.831086 15696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "6962d523143644b5bfae3985f42382ee"
format_stamp: "Formatted at 2026-08-11 18:58:48 on dist-test-slave-1nl6"
server_key: "d681702a7e49d5202baf45b645c10f7f"
server_key_iv: "714ea719b45e4dbdb26942a653765ee8"
server_key_version: "encryptionkey@0"
I20260811 18:58:48.839375 15696 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.004s
I20260811 18:58:48.844285 15720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:48.846066 15696 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 18:58:48.846316 15696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "6962d523143644b5bfae3985f42382ee"
format_stamp: "Formatted at 2026-08-11 18:58:48 on dist-test-slave-1nl6"
server_key: "d681702a7e49d5202baf45b645c10f7f"
server_key_iv: "714ea719b45e4dbdb26942a653765ee8"
server_key_version: "encryptionkey@0"
I20260811 18:58:48.846572 15696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:48.880172 15696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:48.885363 15696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:48.885713 15696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:48.907858 15696 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:40795
I20260811 18:58:48.907930 15795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:40795 every 8 connection(s)
I20260811 18:58:48.909569 15696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:48.915889 15796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:48.919489 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 15696
I20260811 18:58:48.919777 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:58:48.920486 20079 external_mini_cluster.cc:1428] Setting key fcab5a005463ff0a01856f9c6feb2555
I20260811 18:58:48.932296 15796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: Bootstrap starting.
I20260811 18:58:48.936973 15796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: Neither blocks nor log segments found. Creating new log.
Aug 11 18:58:48 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:48.938462 15796 log.cc:824] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:48.942342 15796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: No bootstrap required, opened a new log
I20260811 18:58:48.949010 15801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:48.923192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.19.155.254:40795)
0811 18:58:48.924334 (+ 1142us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:48.924350 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:48.924402 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:58:48.926395 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:48.926425 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:48.926893 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:48.927421 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:48.929555 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:48.931140 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:48.933360 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:48.934185 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:48.934350 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:48.939930 (+ 5580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:48.939949 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:48.939976 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:48.940039 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:48.943717 (+ 3678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:48.944865 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:48.944873 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:48.944881 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:48.945104 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:48.945567 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:48.945579 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:48.945582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:48.946241 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:48.946506 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:48.947138 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 18:58:48.947737 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":871,"thread_start_us":587,"threads_started":1}
I20260811 18:58:48.952636 15796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } }
I20260811 18:58:48.953065 15796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:48.953192 15796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6962d523143644b5bfae3985f42382ee, State: Initialized, Role: FOLLOWER
I20260811 18:58:48.953815 15796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } }
I20260811 18:58:48.954077 15796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:48.954206 15796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:48.954339 15796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:48.957266 15796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } }
I20260811 18:58:48.957890 15796 leader_election.cc:302] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6962d523143644b5bfae3985f42382ee; no voters:
I20260811 18:58:48.958496 15796 leader_election.cc:288] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:48.958658 15804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:48.960318 15804 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [term 1 LEADER]: Becoming Leader. State: Replica: 6962d523143644b5bfae3985f42382ee, State: Running, Role: LEADER
I20260811 18:58:48.961038 15796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:48.960932 15804 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } }
I20260811 18:58:48.964035 15809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6962d523143644b5bfae3985f42382ee. Latest consensus state: current_term: 1 leader_uuid: "6962d523143644b5bfae3985f42382ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } } }
I20260811 18:58:48.964478 15809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:48.965039 15808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6962d523143644b5bfae3985f42382ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6962d523143644b5bfae3985f42382ee" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40795 } } }
I20260811 18:58:48.965377 15808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:48.968016 15818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:48.974179 15818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:48.985141 15818 catalog_manager.cc:1347] Generated new cluster ID: e7997e68e29741a39375c8212d13aa46
I20260811 18:58:48.985284 15818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:49.012173 15818 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:49.014379 15818 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:49.023173 15818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: Generated new TSK 0
I20260811 18:58:49.024448 15818 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:58:49.110749 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:45309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:49.502071 15844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:49.502497 15844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:49.502686 15844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:49.510330 15844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:49.510547 15844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:49.510757 15844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:58:49.521198 15844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:45309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:49.522765 15844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:49.524354 15844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:49.538743 15853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:49.538784 15854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:49.538702 15860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:49.540091 15844 server_base.cc:1034] running on GCE node
I20260811 18:58:49.540858 15844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:49.542027 15844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:49.543270 15844 hybrid_clock.cc:648] HybridClock initialized: now 1786474729543200 us; error 73 us; skew 500 ppm
I20260811 18:58:49.543635 15844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:49 dist-test-slave-1nl6 krb5kdc[15672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474729, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:49.547405 15844 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:58:49.549113 15844 webserver.cc:460] Webserver started at http://127.19.155.193:41181/ using document root <none> and password file <none>
I20260811 18:58:49.549921 15844 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:49.550086 15844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:49.550530 15844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:49.553975 15844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11"
format_stamp: "Formatted at 2026-08-11 18:58:49 on dist-test-slave-1nl6"
server_key: "61aecd098500a7363fca5d7301ffb63b"
server_key_iv: "f0adc681b6b16bb58decd078b7103a1d"
server_key_version: "encryptionkey@0"
I20260811 18:58:49.554862 15844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11"
format_stamp: "Formatted at 2026-08-11 18:58:49 on dist-test-slave-1nl6"
server_key: "61aecd098500a7363fca5d7301ffb63b"
server_key_iv: "f0adc681b6b16bb58decd078b7103a1d"
server_key_version: "encryptionkey@0"
I20260811 18:58:49.561035 15844 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:58:49.565414 15868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:49.567205 15844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:49.567453 15844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11"
format_stamp: "Formatted at 2026-08-11 18:58:49 on dist-test-slave-1nl6"
server_key: "61aecd098500a7363fca5d7301ffb63b"
server_key_iv: "f0adc681b6b16bb58decd078b7103a1d"
server_key_version: "encryptionkey@0"
I20260811 18:58:49.567752 15844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:49.580116 15844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:49.584492 15844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:49.584761 15844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:49.585803 15844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:49.587356 15844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:49.587437 15844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:49.587529 15844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:49.587575 15844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:49.624457 15844 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:40059
I20260811 18:58:49.624511 16051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:40059 every 8 connection(s)
I20260811 18:58:49.625910 15844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:49.629401 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 15844
I20260811 18:58:49.629662 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:49.630599 20079 external_mini_cluster.cc:1428] Setting key 4b84e723af2a8d1c15e077592bd59c11
Aug 11 18:58:49 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474729, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:49.651618 16060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:49.628975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:35609 (local address 127.19.155.254:40795)
0811 18:58:49.629530 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:49.629538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:49.631063 (+ 1525us) server_negotiation.cc:407] Connection header received
0811 18:58:49.633185 (+ 2122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:49.633190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:49.633265 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:49.633360 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:49.635835 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:49.636604 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:49.639401 (+ 2797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:49.639839 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:49.639957 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:49.644869 (+ 4912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:49.644876 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:49.644879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:49.644922 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:49.647863 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:49.648825 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:49.648830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:49.648832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:49.648979 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:49.649515 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:49.649520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:49.649522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:49.649835 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:49.650014 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:49.650950 (+ 936us) server_negotiation.cc:299] Negotiation successful
0811 18:58:49.651219 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":274,"threads_started":1}
I20260811 18:58:49.652750 16061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:49.629571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40795 (local address 127.19.155.193:35609)
0811 18:58:49.630535 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:49.630595 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:49.632835 (+ 2240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:49.633696 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:49.633709 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:49.634586 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:49.635590 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:49.635625 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:49.636817 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:49.636825 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:49.639165 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:49.639199 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:49.640123 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:49.640134 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:49.640524 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:49.641388 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:49.641428 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:49.644516 (+ 3088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:49.648071 (+ 3555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:49.648083 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:49.648107 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:49.648650 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:49.649113 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:49.649118 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:49.649122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:49.649364 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:49.649988 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:49.649998 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:49.650442 (+ 444us) client_negotiation.cc:769] Sending connection context
0811 18:58:49.650792 (+ 350us) client_negotiation.cc:240] Negotiation successful
0811 18:58:49.651433 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":335,"threads_started":1}
I20260811 18:58:49.654664 16052 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40795
I20260811 18:58:49.655092 16052 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:49.655915 16052 heartbeater.cc:511] Master 127.19.155.254:40795 requested a full tablet report, sending...
I20260811 18:58:49.658697 15748 ts_manager.cc:194] Registered new tserver with Master: ffdb7fc92e6a421e9c38e8e53ab92c11 (127.19.155.193:40059)
I20260811 18:58:49.661195 15748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:35609
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:58:49.708395 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:45309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:50.082958 16064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:50.083297 16064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:50.083400 16064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:50.090888 16064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:50.091122 16064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:50.091332 16064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:58:50.101805 16064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:45309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:50.103302 16064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:50.104765 16064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:50.119143 16072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:50.119234 16076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:50.119192 16078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:50.120057 16064 server_base.cc:1034] running on GCE node
I20260811 18:58:50.120822 16064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:50.121899 16064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:50.123135 16064 hybrid_clock.cc:648] HybridClock initialized: now 1786474730123067 us; error 68 us; skew 500 ppm
I20260811 18:58:50.123487 16064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:50 dist-test-slave-1nl6 krb5kdc[15672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474730, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:50.127104 16064 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:58:50.128837 16064 webserver.cc:460] Webserver started at http://127.19.155.194:42961/ using document root <none> and password file <none>
I20260811 18:58:50.129575 16064 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:50.129701 16064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:50.129987 16064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:50.133239 16064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "60d67cc6161e4889a350a9d7ebfc9cfc"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "a8237021b1c4149ac368d65a06da7867"
server_key_iv: "478e16ad9025b36fe4d96431cde9b0a4"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.134084 16064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "60d67cc6161e4889a350a9d7ebfc9cfc"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "a8237021b1c4149ac368d65a06da7867"
server_key_iv: "478e16ad9025b36fe4d96431cde9b0a4"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.141777 16064 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260811 18:58:50.146148 16087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.147694 16064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:50.147894 16064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "60d67cc6161e4889a350a9d7ebfc9cfc"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "a8237021b1c4149ac368d65a06da7867"
server_key_iv: "478e16ad9025b36fe4d96431cde9b0a4"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.148128 16064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:50.164630 16064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:50.169546 16064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:50.169865 16064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:50.170991 16064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:50.172559 16064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:50.172649 16064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.172834 16064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:50.172894 16064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.209013 16064 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:45827
I20260811 18:58:50.209069 16272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:45827 every 8 connection(s)
I20260811 18:58:50.210448 16064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:50.214771 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 16064
I20260811 18:58:50.215019 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:50.215587 20079 external_mini_cluster.cc:1428] Setting key 82095a0b9bee3eb0e942fc702cf0524d
Aug 11 18:58:50 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474730, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:50.232753 16276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.213312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:37201 (local address 127.19.155.254:40795)
0811 18:58:50.213823 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.213828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.215028 (+ 1200us) server_negotiation.cc:407] Connection header received
0811 18:58:50.217243 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.217247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.217327 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.217432 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:50.219315 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.220063 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.221686 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.222148 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.222302 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.226054 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:50.226060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:50.226063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:50.226099 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:50.228975 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.229844 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.229848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.229851 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.229981 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.230474 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.230478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.230480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.230853 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:50.231057 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.231888 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.232236 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":254,"threads_started":1}
I20260811 18:58:50.233657 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.213930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40795 (local address 127.19.155.194:37201)
0811 18:58:50.214739 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:50.214789 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:50.216891 (+ 2102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:50.217805 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:50.217817 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:50.218429 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:50.219124 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.219146 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.220254 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.220259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.221528 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.221542 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.222402 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.222410 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.222665 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.223466 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:50.223489 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:50.225781 (+ 2292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:50.229154 (+ 3373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:50.229165 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:50.229186 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:50.229686 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:50.230106 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:50.230111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:50.230115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:50.230331 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:50.231043 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:50.231051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:50.231469 (+ 418us) client_negotiation.cc:769] Sending connection context
0811 18:58:50.231727 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 18:58:50.232229 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":331,"threads_started":1}
I20260811 18:58:50.235471 16274 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40795
I20260811 18:58:50.235823 16274 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:50.236618 16274 heartbeater.cc:511] Master 127.19.155.254:40795 requested a full tablet report, sending...
I20260811 18:58:50.238329 15748 ts_manager.cc:194] Registered new tserver with Master: 60d67cc6161e4889a350a9d7ebfc9cfc (127.19.155.194:45827)
I20260811 18:58:50.239742 15748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:37201
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:58:50.290653 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:45309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:50.657285 16284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:50.657663 16284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:50.657845 16284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 18:58:50.664924 16052 heartbeater.cc:503] Master 127.19.155.254:40795 was elected leader, sending a full tablet report...
W20260811 18:58:50.665720 16284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:50.665881 16284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:50.666075 16284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:58:50.678169 16284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:45309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:50.679767 16284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:50.681310 16284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:50.697019 16296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:50.696967 16298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:50.696923 16300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:50.697885 16284 server_base.cc:1034] running on GCE node
I20260811 18:58:50.698709 16284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:50.699882 16284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:50.701112 16284 hybrid_clock.cc:648] HybridClock initialized: now 1786474730701051 us; error 52 us; skew 500 ppm
I20260811 18:58:50.701495 16284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:50 dist-test-slave-1nl6 krb5kdc[15672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474730, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:50.705018 16284 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:58:50.706811 16284 webserver.cc:460] Webserver started at http://127.19.155.195:36271/ using document root <none> and password file <none>
I20260811 18:58:50.707633 16284 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:50.707798 16284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:50.708163 16284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:50.711495 16284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "06620ea78f134b6895e0b4b36da0e5a0"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "d05080702c0590b288229f951f0985b9"
server_key_iv: "0cacc90e15d061e9fac6133cfc50549d"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.712409 16284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "06620ea78f134b6895e0b4b36da0e5a0"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "d05080702c0590b288229f951f0985b9"
server_key_iv: "0cacc90e15d061e9fac6133cfc50549d"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.718308 16284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:58:50.722313 16311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.723789 16284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:50.723994 16284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "06620ea78f134b6895e0b4b36da0e5a0"
format_stamp: "Formatted at 2026-08-11 18:58:50 on dist-test-slave-1nl6"
server_key: "d05080702c0590b288229f951f0985b9"
server_key_iv: "0cacc90e15d061e9fac6133cfc50549d"
server_key_version: "encryptionkey@0"
I20260811 18:58:50.724223 16284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:50.750623 16284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:50.756109 16284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:50.756474 16284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:50.757620 16284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:50.759215 16284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:50.759331 16284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.759483 16284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:50.759559 16284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:50.795840 16284 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:45039
I20260811 18:58:50.795895 16489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:45039 every 8 connection(s)
I20260811 18:58:50.797330 16284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:50.805716 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 16284
I20260811 18:58:50.805949 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:50.806485 20079 external_mini_cluster.cc:1428] Setting key fa7aaa5a062fba98a208b5bf3523af93
Aug 11 18:58:50 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474730, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:50.819851 16493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.800228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:51057 (local address 127.19.155.254:40795)
0811 18:58:50.800734 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.800739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.801726 (+ 987us) server_negotiation.cc:407] Connection header received
0811 18:58:50.803748 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.803754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.803868 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.803996 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:50.805958 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.806980 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.809012 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.809453 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.809559 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.813547 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:50.813553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:50.813557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:50.813599 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:50.816368 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.817293 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.817298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.817300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.817443 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.817934 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.817938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.817941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.818276 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:50.818431 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.819328 (+ 897us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.819548 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":261,"threads_started":1}
I20260811 18:58:50.821033 16494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.800684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40795 (local address 127.19.155.195:51057)
0811 18:58:50.801548 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:50.801608 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:50.803462 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:50.804247 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:50.804256 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:50.804894 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:50.805698 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.805728 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.807150 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.807154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.808852 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.808866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.809710 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.809719 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.809981 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.810815 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:50.810846 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:50.813267 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:50.816566 (+ 3299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:50.816582 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:50.816600 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:50.817141 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:50.817558 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:50.817561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:50.817563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:50.817784 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:50.818410 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:50.818417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:50.818798 (+ 381us) client_negotiation.cc:769] Sending connection context
0811 18:58:50.819153 (+ 355us) client_negotiation.cc:240] Negotiation successful
0811 18:58:50.819621 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":286,"threads_started":1}
I20260811 18:58:50.822772 16490 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40795
I20260811 18:58:50.823256 16490 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:50.824098 16490 heartbeater.cc:511] Master 127.19.155.254:40795 requested a full tablet report, sending...
I20260811 18:58:50.825791 15748 ts_manager.cc:194] Registered new tserver with Master: 06620ea78f134b6895e0b4b36da0e5a0 (127.19.155.195:45039)
I20260811 18:58:50.826665 15748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:51057
I20260811 18:58:50.836083 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:50.856072 16493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.841292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.19.155.254:40795)
0811 18:58:50.841491 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.841496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.842016 (+ 520us) server_negotiation.cc:407] Connection header received
0811 18:58:50.842199 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.842203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.842280 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.842385 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:50.844135 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.844913 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.846528 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.847062 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.847192 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.849930 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:50.849935 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:50.849939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:50.849982 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:50.853179 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.854055 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.854060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.854062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.854231 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:50.854635 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:50.854638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:50.854640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:50.855036 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:50.855270 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.855601 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.855820 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:58:50.861308 15748 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:50.869124 15748 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:50.906033 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.884970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:45039 (local address 127.0.0.1:38618)
0811 18:58:50.892245 (+ 7275us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:50.893046 (+ 801us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:50.893330 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:50.894839 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:50.894848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:50.894922 (+ 74us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:50.895497 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.895518 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.898826 (+ 3308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.898836 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.902469 (+ 3633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.902498 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.904844 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.904862 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.905108 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.905187 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 18:58:50.905309 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 18:58:50.905543 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6948,"mutex_wait_us":4,"thread_start_us":9173,"threads_started":1}
I20260811 18:58:50.907009 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.885333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40059 (local address 127.0.0.1:39896)
0811 18:58:50.894467 (+ 9134us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:50.894490 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:50.894626 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:50.895862 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:50.895871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:50.895909 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:50.896505 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.896524 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.901178 (+ 4654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.901188 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.904479 (+ 3291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.904502 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.906049 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.906057 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.906228 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.906262 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 18:58:50.906362 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:58:50.906515 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8990,"mutex_wait_us":1,"thread_start_us":6384,"threads_started":1}
I20260811 18:58:50.907393 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.885041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.19.155.195:45039)
0811 18:58:50.894160 (+ 9119us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.894167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.894198 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:58:50.894283 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.894289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.894507 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.895801 (+ 1294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:50.896224 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.898550 (+ 2326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.902887 (+ 4337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.904600 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.906467 (+ 1867us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.906678 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.906762 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.907006 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8951,"thread_start_us":8777,"threads_started":1}
I20260811 18:58:50.907570 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.885868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39896 (local address 127.19.155.193:40059)
0811 18:58:50.893099 (+ 7231us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.893110 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.894779 (+ 1669us) server_negotiation.cc:407] Connection header received
0811 18:58:50.894944 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.894956 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.895262 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.895514 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:50.896802 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.900894 (+ 4092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.904721 (+ 3827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.905791 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.906038 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.906270 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.906985 (+ 715us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.907177 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7029,"thread_start_us":6858,"threads_started":1}
I20260811 18:58:50.911985 15938 tablet_service.cc:1467] Processing CreateTablet for tablet 365403c45aea4399ae15e286daf83e82 (DEFAULT_TABLE table=test-table [id=275d581c6136485e86069146baaf7500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:50.912014 16386 tablet_service.cc:1467] Processing CreateTablet for tablet 365403c45aea4399ae15e286daf83e82 (DEFAULT_TABLE table=test-table [id=275d581c6136485e86069146baaf7500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:50.913653 16386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 365403c45aea4399ae15e286daf83e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:50.913653 15938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 365403c45aea4399ae15e286daf83e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:50.919214 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.894645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45827 (local address 127.0.0.1:36770)
0811 18:58:50.902378 (+ 7733us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:50.902402 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:50.902562 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:50.904206 (+ 1644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:50.904212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:50.904241 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:50.904712 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.904733 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.906816 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.906823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.913914 (+ 7091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:50.913940 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.916518 (+ 2578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.916527 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:50.918394 (+ 1867us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.918442 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:58:50.918563 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 18:58:50.918744 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7548,"thread_start_us":8026,"threads_started":1}
I20260811 18:58:50.920284 16520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:50.894986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36770 (local address 127.19.155.194:45827)
0811 18:58:50.903435 (+ 8449us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:50.903445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:50.903478 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:58:50.903606 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:50.903614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:50.903935 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:50.904792 (+ 857us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:50.905054 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.906604 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.914211 (+ 7607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:50.915883 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:50.916105 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:50.916303 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:50.919699 (+ 3396us) server_negotiation.cc:299] Negotiation successful
0811 18:58:50.919924 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8266,"thread_start_us":8105,"threads_started":1}
I20260811 18:58:50.925242 16169 tablet_service.cc:1467] Processing CreateTablet for tablet 365403c45aea4399ae15e286daf83e82 (DEFAULT_TABLE table=test-table [id=275d581c6136485e86069146baaf7500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:50.929299 16169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 365403c45aea4399ae15e286daf83e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:50.933166 16524 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Bootstrap starting.
I20260811 18:58:50.935828 16521 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Bootstrap starting.
I20260811 18:58:50.938409 16524 tablet_bootstrap.cc:654] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:50.940215 16521 tablet_bootstrap.cc:654] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:50.940148 16524 log.cc:824] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:50.941747 16521 log.cc:824] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:50.944612 16524 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: No bootstrap required, opened a new log
I20260811 18:58:50.944998 16524 ts_tablet_manager.cc:1397] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260811 18:58:50.945254 16521 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: No bootstrap required, opened a new log
I20260811 18:58:50.945575 16521 ts_tablet_manager.cc:1397] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260811 18:58:50.947767 16529 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Bootstrap starting.
I20260811 18:58:50.952628 16529 tablet_bootstrap.cc:654] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:50.954110 16529 log.cc:824] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:50.957412 16529 tablet_bootstrap.cc:492] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: No bootstrap required, opened a new log
I20260811 18:58:50.957172 16521 raft_consensus.cc:348] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.957171 16524 raft_consensus.cc:348] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.957727 16524 raft_consensus.cc:374] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:50.957731 16521 raft_consensus.cc:374] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:50.957811 16529 ts_tablet_manager.cc:1397] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 18:58:50.957847 16524 raft_consensus.cc:729] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06620ea78f134b6895e0b4b36da0e5a0, State: Initialized, Role: FOLLOWER
I20260811 18:58:50.957847 16521 raft_consensus.cc:729] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffdb7fc92e6a421e9c38e8e53ab92c11, State: Initialized, Role: FOLLOWER
I20260811 18:58:50.958624 16524 consensus_queue.cc:260] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.958629 16521 consensus_queue.cc:260] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.960024 16490 heartbeater.cc:503] Master 127.19.155.254:40795 was elected leader, sending a full tablet report...
I20260811 18:58:50.961113 16521 ts_tablet_manager.cc:1428] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260811 18:58:50.961980 16524 ts_tablet_manager.cc:1428] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260811 18:58:50.970784 16529 raft_consensus.cc:348] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.971328 16529 raft_consensus.cc:374] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:50.971422 16529 raft_consensus.cc:729] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d67cc6161e4889a350a9d7ebfc9cfc, State: Initialized, Role: FOLLOWER
I20260811 18:58:50.972041 16529 consensus_queue.cc:260] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:50.973378 16274 heartbeater.cc:503] Master 127.19.155.254:40795 was elected leader, sending a full tablet report...
I20260811 18:58:50.974186 16529 ts_tablet_manager.cc:1428] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
W20260811 18:58:51.049173 16492 tablet.cc:2369] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:51.128999 16058 tablet.cc:2369] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:51.145556 16532 raft_consensus.cc:482] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:51.145964 16532 raft_consensus.cc:504] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:51.148079 16532 leader_election.cc:288] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d67cc6161e4889a350a9d7ebfc9cfc (127.19.155.194:45827), ffdb7fc92e6a421e9c38e8e53ab92c11 (127.19.155.193:40059)
I20260811 18:58:51.155157 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.148765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:36215 (local address 127.19.155.193:40059)
0811 18:58:51.149015 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.149024 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.149051 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:51.149142 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.149149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.149240 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.149356 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:51.149948 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.151023 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.153050 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.154130 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.154257 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.154313 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.154715 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.154864 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:58:51.155262 16494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.148426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:40059 (local address 127.19.155.195:36215)
0811 18:58:51.148638 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:51.148666 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:51.148834 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:51.149394 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:51.149397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:51.149433 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:51.149758 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:51.149771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.151172 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.151178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:51.152879 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:51.152893 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.154295 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.154301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:51.154511 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.154549 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:58:51.154663 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:58:51.154824 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":2,"spinlock_wait_cycles":44416}
I20260811 18:58:51.155613 16520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.148503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:43391 (local address 127.19.155.194:45827)
0811 18:58:51.148712 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.148720 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.149530 (+ 810us) server_negotiation.cc:407] Connection header received
0811 18:58:51.149729 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.149734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.149817 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.149924 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:51.150507 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.151460 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.153548 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.154562 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.154726 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.154795 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.155196 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.155356 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:58:51.155735 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.148445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45827 (local address 127.19.155.195:43391)
0811 18:58:51.149398 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:51.149419 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:51.149573 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:51.149948 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:51.149952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:51.149977 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:51.150338 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:51.150361 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.151617 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.151621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:51.153384 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:51.153402 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.154791 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.154798 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:51.155002 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.155041 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:58:51.155147 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:58:51.155317 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":106,"thread_start_us":466,"threads_started":1}
I20260811 18:58:51.156512 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "365403c45aea4399ae15e286daf83e82" candidate_uuid: "06620ea78f134b6895e0b4b36da0e5a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" is_pre_election: true
I20260811 18:58:51.156824 16200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "365403c45aea4399ae15e286daf83e82" candidate_uuid: "06620ea78f134b6895e0b4b36da0e5a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" is_pre_election: true
I20260811 18:58:51.157079 15973 raft_consensus.cc:2454] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06620ea78f134b6895e0b4b36da0e5a0 in term 0.
I20260811 18:58:51.157357 16200 raft_consensus.cc:2454] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06620ea78f134b6895e0b4b36da0e5a0 in term 0.
I20260811 18:58:51.157864 16313 leader_election.cc:302] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06620ea78f134b6895e0b4b36da0e5a0, ffdb7fc92e6a421e9c38e8e53ab92c11; no voters:
I20260811 18:58:51.158332 16532 raft_consensus.cc:2781] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:51.158499 16532 raft_consensus.cc:482] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:51.158620 16532 raft_consensus.cc:3037] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:51.161190 16532 raft_consensus.cc:504] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:51.162081 16532 leader_election.cc:288] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [CANDIDATE]: Term 1 election: Requested vote from peers 60d67cc6161e4889a350a9d7ebfc9cfc (127.19.155.194:45827), ffdb7fc92e6a421e9c38e8e53ab92c11 (127.19.155.193:40059)
I20260811 18:58:51.162667 16200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "365403c45aea4399ae15e286daf83e82" candidate_uuid: "06620ea78f134b6895e0b4b36da0e5a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc"
I20260811 18:58:51.162806 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "365403c45aea4399ae15e286daf83e82" candidate_uuid: "06620ea78f134b6895e0b4b36da0e5a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11"
I20260811 18:58:51.162966 16200 raft_consensus.cc:3037] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:51.163070 15973 raft_consensus.cc:3037] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:51.166600 16200 raft_consensus.cc:2454] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06620ea78f134b6895e0b4b36da0e5a0 in term 1.
I20260811 18:58:51.166600 15973 raft_consensus.cc:2454] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06620ea78f134b6895e0b4b36da0e5a0 in term 1.
I20260811 18:58:51.167285 16312 leader_election.cc:302] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 06620ea78f134b6895e0b4b36da0e5a0, 60d67cc6161e4889a350a9d7ebfc9cfc, ffdb7fc92e6a421e9c38e8e53ab92c11; no voters:
I20260811 18:58:51.167758 16532 raft_consensus.cc:2781] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:51.168341 16532 raft_consensus.cc:686] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 1 LEADER]: Becoming Leader. State: Replica: 06620ea78f134b6895e0b4b36da0e5a0, State: Running, Role: LEADER
I20260811 18:58:51.169098 16532 consensus_queue.cc:237] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } }
I20260811 18:58:51.174594 15748 catalog_manager.cc:5495] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06620ea78f134b6895e0b4b36da0e5a0 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "06620ea78f134b6895e0b4b36da0e5a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06620ea78f134b6895e0b4b36da0e5a0" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 45039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:51.198053 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.192061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.19.155.195:45039)
0811 18:58:51.192304 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.192312 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.192334 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:58:51.192538 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.192543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.192639 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.192816 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:51.193251 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.194007 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.195612 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.196048 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.196198 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.196808 (+ 610us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:51.197370 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:51.197544 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.197659 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.197756 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:58:51.207386 15973 raft_consensus.cc:1261] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 1 FOLLOWER]: Refusing update from remote peer 06620ea78f134b6895e0b4b36da0e5a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:51.207391 16200 raft_consensus.cc:1261] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 1 FOLLOWER]: Refusing update from remote peer 06620ea78f134b6895e0b4b36da0e5a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:51.208655 16532 consensus_queue.cc:1035] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d67cc6161e4889a350a9d7ebfc9cfc" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:51.209116 16536 consensus_queue.cc:1035] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffdb7fc92e6a421e9c38e8e53ab92c11" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 40059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:58:51.213047 16275 tablet.cc:2369] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:51.245659 15746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:51.246075 15746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:51.250626 15746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6962d523143644b5bfae3985f42382ee: Sending DeleteTablet for 3 replicas of tablet 365403c45aea4399ae15e286daf83e82
I20260811 18:58:51.252233 16169 tablet_service.cc:1514] Processing DeleteTablet for tablet 365403c45aea4399ae15e286daf83e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:51 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:36770
I20260811 18:58:51.252213 16386 tablet_service.cc:1514] Processing DeleteTablet for tablet 365403c45aea4399ae15e286daf83e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:51 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:38618
I20260811 18:58:51.253146 15938 tablet_service.cc:1514] Processing DeleteTablet for tablet 365403c45aea4399ae15e286daf83e82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:51 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:39896
I20260811 18:58:51.253340 16559 tablet_replica.cc:330] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: stopping tablet replica
I20260811 18:58:51.253908 16559 raft_consensus.cc:2229] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:51.254509 16559 raft_consensus.cc:2258] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:51.255340 16561 tablet_replica.cc:330] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: stopping tablet replica
I20260811 18:58:51.255761 16561 raft_consensus.cc:2229] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:51.256265 16561 raft_consensus.cc:2258] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:51.257083 16558 tablet_replica.cc:330] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: stopping tablet replica
I20260811 18:58:51.257535 16558 raft_consensus.cc:2229] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:51.258397 16558 raft_consensus.cc:2258] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:51.259240 16559 ts_tablet_manager.cc:1905] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:51.259649 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 15844
I20260811 18:58:51.260546 16561 ts_tablet_manager.cc:1905] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:51.263259 16558 ts_tablet_manager.cc:1905] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:51.268494 16559 ts_tablet_manager.cc:1918] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:51.268882 16559 log.cc:1196] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/365403c45aea4399ae15e286daf83e82
I20260811 18:58:51.269732 16559 ts_tablet_manager.cc:1939] T 365403c45aea4399ae15e286daf83e82 P 60d67cc6161e4889a350a9d7ebfc9cfc: Deleting consensus metadata
I20260811 18:58:51.272423 15721 catalog_manager.cc:4841] TS 60d67cc6161e4889a350a9d7ebfc9cfc (127.19.155.194:45827): tablet 365403c45aea4399ae15e286daf83e82 (table test-table [id=275d581c6136485e86069146baaf7500]) successfully deleted
I20260811 18:58:51.273732 16558 ts_tablet_manager.cc:1918] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:51.274030 16558 log.cc:1196] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/365403c45aea4399ae15e286daf83e82
I20260811 18:58:51.274744 16558 ts_tablet_manager.cc:1939] T 365403c45aea4399ae15e286daf83e82 P 06620ea78f134b6895e0b4b36da0e5a0: Deleting consensus metadata
I20260811 18:58:51.276878 15721 catalog_manager.cc:4841] TS 06620ea78f134b6895e0b4b36da0e5a0 (127.19.155.195:45039): tablet 365403c45aea4399ae15e286daf83e82 (table test-table [id=275d581c6136485e86069146baaf7500]) successfully deleted
I20260811 18:58:51.280293 16561 ts_tablet_manager.cc:1918] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:51.280539 16561 log.cc:1196] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/365403c45aea4399ae15e286daf83e82
I20260811 18:58:51.281153 16561 ts_tablet_manager.cc:1939] T 365403c45aea4399ae15e286daf83e82 P ffdb7fc92e6a421e9c38e8e53ab92c11: Deleting consensus metadata
Aug 11 18:58:51 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:58:51.283413 15722 catalog_manager.cc:4841] TS ffdb7fc92e6a421e9c38e8e53ab92c11 (127.19.155.193:40059): tablet 365403c45aea4399ae15e286daf83e82 (table test-table [id=275d581c6136485e86069146baaf7500]) successfully deleted
I20260811 18:58:51.290512 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.260928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39906 (local address 127.19.155.193:40059)
0811 18:58:51.261122 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.261129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.272039 (+ 10910us) server_negotiation.cc:407] Connection header received
0811 18:58:51.272829 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.272835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.272926 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.273030 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:51.275494 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.276647 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.278024 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.278498 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.278654 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.283834 (+ 5180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:51.283849 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:51.283865 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:51.283911 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:51.287236 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.288152 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.288161 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.288164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.288325 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.288774 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.288778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.288780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.289187 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:51.289533 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.289877 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.290123 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 18:58:51.291357 16046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:51.413156 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 15844
I20260811 18:58:51.447655 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 16064
Aug 11 18:58:51 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:58:51.466341 16520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.448578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.19.155.194:45827)
0811 18:58:51.448786 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.448794 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.448817 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:58:51.448952 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.448958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.449047 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.449165 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:51.450594 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.451803 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.453251 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.453921 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.454070 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.458653 (+ 4583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:51.458676 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:51.458700 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:51.458761 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:51.463017 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.463923 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.463935 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.463939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.464121 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.464583 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.464589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.464592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.465113 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:51.465446 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.465690 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.465940 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:58:51.467223 16266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:51.560075 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 16064
I20260811 18:58:51.597280 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 16284
Aug 11 18:58:51 dist-test-slave-1nl6 krb5kdc[15672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:58:51.617125 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:51.598144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38628 (local address 127.19.155.195:45039)
0811 18:58:51.598327 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:51.598333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:51.598360 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:58:51.598576 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:51.598580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:51.598643 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:51.598745 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:51.600766 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.601611 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.603809 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:51.604275 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:51.604396 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:51.610297 (+ 5901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:51.610316 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:51.610335 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:51.610395 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:51.613794 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.614655 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.614664 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.614667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.614848 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:51.615373 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:51.615377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:51.615379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:51.615791 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:51.616146 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:51.616462 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 18:58:51.616728 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:58:51.617928 16484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:51.744573 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 16284
I20260811 18:58:51.774372 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 15696
I20260811 18:58:51.775713 15791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:51.895605 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 15696
2026-08-11T18:58:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5283 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T18:58:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:51Z Disabled control of system clock
I20260811 18:58:52.007211 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36265
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:36265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:58:52.379768 16581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:52.380096 16581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:52.380183 16581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:52.387692 16581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:52.387869 16581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:52.387950 16581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:52.388033 16581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:52.388082 16581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:52.397791 16581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:36265
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:52.399277 16581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:52.401127 16581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:52.413832 16589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:52.413841 16591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:52.413717 16595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:52.414853 16581 server_base.cc:1034] running on GCE node
I20260811 18:58:52.415802 16581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:52.417430 16581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:52.418653 16581 hybrid_clock.cc:648] HybridClock initialized: now 1786474732418589 us; error 74 us; skew 500 ppm
I20260811 18:58:52.419126 16581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:58:52.421591 16581 webserver.cc:460] Webserver started at http://127.19.155.254:40677/ using document root <none> and password file <none>
I20260811 18:58:52.422371 16581 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:52.422499 16581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:52.422880 16581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:52.425985 16581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "22132c01dc7c401ca085235a44daf0d0"
format_stamp: "Formatted at 2026-08-11 18:58:52 on dist-test-slave-1nl6"
server_key: "304d78ee37b24c6adbc45016cbea21dc"
server_key_iv: "a331de20531250429ae999ffb3107403"
server_key_version: "encryptionkey@0"
I20260811 18:58:52.426834 16581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "22132c01dc7c401ca085235a44daf0d0"
format_stamp: "Formatted at 2026-08-11 18:58:52 on dist-test-slave-1nl6"
server_key: "304d78ee37b24c6adbc45016cbea21dc"
server_key_iv: "a331de20531250429ae999ffb3107403"
server_key_version: "encryptionkey@0"
I20260811 18:58:52.432461 16581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 18:58:52.436216 16605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:52.437610 16581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:58:52.437814 16581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "22132c01dc7c401ca085235a44daf0d0"
format_stamp: "Formatted at 2026-08-11 18:58:52 on dist-test-slave-1nl6"
server_key: "304d78ee37b24c6adbc45016cbea21dc"
server_key_iv: "a331de20531250429ae999ffb3107403"
server_key_version: "encryptionkey@0"
I20260811 18:58:52.438050 16581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:52.453833 16581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:52.454766 16581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:52.455133 16581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:52.475016 16581 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:36265
I20260811 18:58:52.475073 16681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:36265 every 8 connection(s)
I20260811 18:58:52.476544 16581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:52.479993 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 16581
I20260811 18:58:52.480190 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:58:52.480686 20079 external_mini_cluster.cc:1428] Setting key 1a6752c41d986640f1ee7a3ce1c00bf6
I20260811 18:58:52.480757 16682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:52.497187 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:52.482753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36186 (local address 127.19.155.254:36265)
0811 18:58:52.483956 (+ 1203us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:52.483972 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:52.484029 (+ 57us) server_negotiation.cc:407] Connection header received
0811 18:58:52.486176 (+ 2147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:52.486208 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:52.486857 (+ 649us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:52.487373 (+ 516us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:52.487958 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:52.490017 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:52.491588 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:52.492703 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:52.492916 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:52.494113 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:52.494125 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:52.494152 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:52.494993 (+ 841us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:52.495102 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:52.495130 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:52.495249 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:52.495470 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 18:58:52.495833 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":400,"threads_started":1}
I20260811 18:58:52.497195 16682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: Bootstrap starting.
I20260811 18:58:52.500675 16682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:52.501674 16682 log.cc:824] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:52.504588 16682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: No bootstrap required, opened a new log
I20260811 18:58:52.512341 16682 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } }
I20260811 18:58:52.512806 16682 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:52.512933 16682 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22132c01dc7c401ca085235a44daf0d0, State: Initialized, Role: FOLLOWER
I20260811 18:58:52.513551 16682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } }
I20260811 18:58:52.513823 16682 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:52.513988 16682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:52.514175 16682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:52.516646 16682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } }
I20260811 18:58:52.517233 16682 leader_election.cc:302] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22132c01dc7c401ca085235a44daf0d0; no voters:
I20260811 18:58:52.517896 16682 leader_election.cc:288] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:52.518043 16689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:52.518823 16689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [term 1 LEADER]: Becoming Leader. State: Replica: 22132c01dc7c401ca085235a44daf0d0, State: Running, Role: LEADER
I20260811 18:58:52.519452 16689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } }
I20260811 18:58:52.520349 16682 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:52.522750 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22132c01dc7c401ca085235a44daf0d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } } }
I20260811 18:58:52.522747 16691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22132c01dc7c401ca085235a44daf0d0. Latest consensus state: current_term: 1 leader_uuid: "22132c01dc7c401ca085235a44daf0d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22132c01dc7c401ca085235a44daf0d0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36265 } } }
I20260811 18:58:52.523272 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:52.523285 16691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:52.527989 16697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:52.533527 16697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:52.544013 16697 catalog_manager.cc:1347] Generated new cluster ID: 0ecd24f1b6374794a17298773a6cba83
I20260811 18:58:52.544160 16697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:52.558892 16697 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:52.560320 16697 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:52.568248 16697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: Generated new TSK 0
I20260811 18:58:52.569164 16697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:58:52.580533 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--builtin_ntp_servers=127.19.155.212:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:58:52.959972 16716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:52.960314 16716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:52.960408 16716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:52.967990 16716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:52.968118 16716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:52.968238 16716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:58:52.977974 16716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:52.979415 16716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:52.981278 16716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:52.996312 16733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:52.996284 16727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:52.996820 16725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:52.997565 16716 server_base.cc:1034] running on GCE node
I20260811 18:58:52.998265 16716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:52.999450 16716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:53.000674 16716 hybrid_clock.cc:648] HybridClock initialized: now 1786474733000630 us; error 29 us; skew 500 ppm
I20260811 18:58:53.001046 16716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:58:53.003780 16716 webserver.cc:460] Webserver started at http://127.19.155.193:34215/ using document root <none> and password file <none>
I20260811 18:58:53.004576 16716 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:53.004709 16716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:53.005071 16716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:53.008435 16716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "f445a97d5c5b484cb6ff2b96d816fdd6"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "6e62b8b17cea255450999e05f2126ce6"
server_key_iv: "2672e9279caf853ae86a8951b32d54a5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.009383 16716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "f445a97d5c5b484cb6ff2b96d816fdd6"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "6e62b8b17cea255450999e05f2126ce6"
server_key_iv: "2672e9279caf853ae86a8951b32d54a5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.015419 16716 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 18:58:53.019556 16746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.021227 16716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:58:53.021469 16716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "f445a97d5c5b484cb6ff2b96d816fdd6"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "6e62b8b17cea255450999e05f2126ce6"
server_key_iv: "2672e9279caf853ae86a8951b32d54a5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.021741 16716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:53.053294 16716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:53.054526 16716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:53.054970 16716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:53.056231 16716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:53.057953 16716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:53.058048 16716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.058219 16716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:53.058307 16716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.093439 16716 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:36631
I20260811 18:58:53.093545 16926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:36631 every 8 connection(s)
I20260811 18:58:53.095041 16716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:53.099924 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 16716
I20260811 18:58:53.100119 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:53.100561 20079 external_mini_cluster.cc:1428] Setting key 4448929b56c00f7e7ab3b42fd83846cc
I20260811 18:58:53.103523 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--builtin_ntp_servers=127.19.155.212:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:58:53.109220 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:53.098042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:46665 (local address 127.19.155.254:36265)
0811 18:58:53.098564 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:53.098571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:53.100011 (+ 1440us) server_negotiation.cc:407] Connection header received
0811 18:58:53.101986 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:53.101991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:53.102092 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:53.102225 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:53.103525 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.104345 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.105993 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.106436 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.106589 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:53.108237 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:53.108243 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:53.108247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:53.108269 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:53.108314 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:53.108326 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:53.108431 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:53.108705 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:58:53.108825 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260811 18:58:53.110368 16937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:53.098754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36265 (local address 127.19.155.193:46665)
0811 18:58:53.099832 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:53.099871 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:53.101690 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:53.102510 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:53.102519 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:53.102615 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:53.103323 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:53.103347 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.104528 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.104532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:53.105823 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:53.105836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.106704 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.106711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:53.107054 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:53.107855 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:53.107858 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:53.107910 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:53.108005 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:53.108432 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:53.108449 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:53.108459 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:58:53.108671 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 18:58:53.109141 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":319,"threads_started":1}
I20260811 18:58:53.112255 16933 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36265
I20260811 18:58:53.112598 16933 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:53.113440 16933 heartbeater.cc:511] Master 127.19.155.254:36265 requested a full tablet report, sending...
I20260811 18:58:53.116042 16634 ts_manager.cc:194] Registered new tserver with Master: f445a97d5c5b484cb6ff2b96d816fdd6 (127.19.155.193:36631)
I20260811 18:58:53.117717 16634 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.193:46665
W20260811 18:58:53.469485 16942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:53.469798 16942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:53.469959 16942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:53.477746 16942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:53.477901 16942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:53.478091 16942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:58:53.487617 16942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:53.489061 16942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:53.490973 16942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:53.505262 16951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:53.505262 16953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:53.505563 16957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:53.505983 16942 server_base.cc:1034] running on GCE node
I20260811 18:58:53.506732 16942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:53.507830 16942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:53.509099 16942 hybrid_clock.cc:648] HybridClock initialized: now 1786474733509025 us; error 63 us; skew 500 ppm
I20260811 18:58:53.509479 16942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:58:53.511988 16942 webserver.cc:460] Webserver started at http://127.19.155.194:45195/ using document root <none> and password file <none>
I20260811 18:58:53.512753 16942 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:53.512895 16942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:53.513242 16942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:53.516413 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "5b29419e21214476a6b25914c7a1cc79"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "1d38a43001a4383f3535ecf32f8b2dea"
server_key_iv: "e4470507901ffe1e53a441bdb576d6f5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.517292 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "5b29419e21214476a6b25914c7a1cc79"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "1d38a43001a4383f3535ecf32f8b2dea"
server_key_iv: "e4470507901ffe1e53a441bdb576d6f5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.523435 16942 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260811 18:58:53.527371 16968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.528884 16942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:58:53.529100 16942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "5b29419e21214476a6b25914c7a1cc79"
format_stamp: "Formatted at 2026-08-11 18:58:53 on dist-test-slave-1nl6"
server_key: "1d38a43001a4383f3535ecf32f8b2dea"
server_key_iv: "e4470507901ffe1e53a441bdb576d6f5"
server_key_version: "encryptionkey@0"
I20260811 18:58:53.529366 16942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:53.556522 16942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:53.557502 16942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:53.557858 16942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:53.559069 16942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:53.560797 16942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:53.560932 16942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.561074 16942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:53.561170 16942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:53.596807 16942 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:34941
I20260811 18:58:53.596971 17154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:34941 every 8 connection(s)
I20260811 18:58:53.598255 16942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:53.600247 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 16942
I20260811 18:58:53.600458 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:53.600951 20079 external_mini_cluster.cc:1428] Setting key 37128e1a2b8e12151f1fc6d905a107c0
I20260811 18:58:53.604027 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--builtin_ntp_servers=127.19.155.212:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:58:53.613310 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:53.601386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:52537 (local address 127.19.155.254:36265)
0811 18:58:53.601617 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:53.601624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:53.603474 (+ 1850us) server_negotiation.cc:407] Connection header received
0811 18:58:53.605370 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:53.605378 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:53.605477 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:53.605597 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:53.606701 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.607908 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.609511 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.610291 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.610438 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:53.612523 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:53.612529 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:53.612532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:53.612555 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:53.612590 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:53.612602 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:53.612680 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:53.612977 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 18:58:53.613067 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:58:53.614993 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:53.602098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36265 (local address 127.19.155.194:52537)
0811 18:58:53.603283 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:53.603331 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:53.605079 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:53.605804 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:53.605812 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:53.605911 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:53.606519 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:53.606537 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.608068 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.608072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:53.609351 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:53.609364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:53.610766 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:53.610777 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:53.611190 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:53.612065 (+ 875us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:53.612071 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:53.612163 (+ 92us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:53.612292 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:53.612711 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:53.612726 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:53.612738 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:58:53.612964 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 18:58:53.613452 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":371,"threads_started":1}
I20260811 18:58:53.616591 17155 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36265
I20260811 18:58:53.616981 17155 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:53.618009 17155 heartbeater.cc:511] Master 127.19.155.254:36265 requested a full tablet report, sending...
I20260811 18:58:53.619690 16634 ts_manager.cc:194] Registered new tserver with Master: 5b29419e21214476a6b25914c7a1cc79 (127.19.155.194:34941)
I20260811 18:58:53.620546 16634 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.194:52537
W20260811 18:58:53.990727 17161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:53.991189 17161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:53.991365 17161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:53.999073 17161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:53.999241 17161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:53.999428 17161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:58:54.009127 17161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36265
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:54.010612 17161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:54.012846 17161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:54.027567 17167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:54.027516 17166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:54.028296 17169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:54.029485 17161 server_base.cc:1034] running on GCE node
I20260811 18:58:54.030196 17161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:54.031401 17161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:54.032698 17161 hybrid_clock.cc:648] HybridClock initialized: now 1786474734032611 us; error 61 us; skew 500 ppm
I20260811 18:58:54.033139 17161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:58:54.036026 17161 webserver.cc:460] Webserver started at http://127.19.155.195:41991/ using document root <none> and password file <none>
I20260811 18:58:54.036854 17161 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:54.037007 17161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:54.037377 17161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:54.040859 17161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "46aeadf7a64f429c9bca32a7af6a4c3e"
format_stamp: "Formatted at 2026-08-11 18:58:54 on dist-test-slave-1nl6"
server_key: "0a96bd2e22b11c61698ed4837bda3715"
server_key_iv: "dcac3ef6a221c881f1cb52c546feae24"
server_key_version: "encryptionkey@0"
I20260811 18:58:54.041901 17161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "46aeadf7a64f429c9bca32a7af6a4c3e"
format_stamp: "Formatted at 2026-08-11 18:58:54 on dist-test-slave-1nl6"
server_key: "0a96bd2e22b11c61698ed4837bda3715"
server_key_iv: "dcac3ef6a221c881f1cb52c546feae24"
server_key_version: "encryptionkey@0"
I20260811 18:58:54.048635 17161 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260811 18:58:54.052979 17179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:54.054539 17161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:58:54.054790 17161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "46aeadf7a64f429c9bca32a7af6a4c3e"
format_stamp: "Formatted at 2026-08-11 18:58:54 on dist-test-slave-1nl6"
server_key: "0a96bd2e22b11c61698ed4837bda3715"
server_key_iv: "dcac3ef6a221c881f1cb52c546feae24"
server_key_version: "encryptionkey@0"
I20260811 18:58:54.055160 17161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:54.078155 17161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:54.079239 17161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:54.079604 17161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:54.080786 17161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:54.082695 17161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:54.082832 17161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:54.083009 17161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:54.083082 17161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:54.120168 17161 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:37871
I20260811 18:58:54.120317 17359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:37871 every 8 connection(s)
I20260811 18:58:54.121209 16933 heartbeater.cc:503] Master 127.19.155.254:36265 was elected leader, sending a full tablet report...
I20260811 18:58:54.122079 17161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:54.123706 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 17161
I20260811 18:58:54.123896 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:54.124367 20079 external_mini_cluster.cc:1428] Setting key 20bc9704089b364b43a4fea951f01d3f
I20260811 18:58:54.145705 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.127329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:45177 (local address 127.19.155.254:36265)
0811 18:58:54.135059 (+ 7730us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.135064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.135088 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:58:54.135151 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.135155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.135233 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.135356 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:54.136870 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.138181 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.141618 (+ 3437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.142407 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.142643 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.144675 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:54.144681 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:54.144684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:54.144705 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:54.144751 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:54.144765 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:54.144875 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.145162 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.145280 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7540,"thread_start_us":7420,"threads_started":1}
I20260811 18:58:54.147459 17362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.126675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36265 (local address 127.19.155.195:45177)
0811 18:58:54.128266 (+ 1591us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.128331 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.130875 (+ 2544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.135715 (+ 4840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.135727 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.135867 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:54.136613 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.136637 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.138547 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.138556 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.141301 (+ 2745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.141338 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.142797 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.142809 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.143256 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.144249 (+ 993us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:58:54.144252 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:54.144302 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:58:54.144412 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:54.144881 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:54.144896 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:54.144906 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.145131 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.145643 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"spinlock_wait_cycles":22400,"thread_start_us":706,"threads_started":1}
I20260811 18:58:54.149331 17360 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36265
I20260811 18:58:54.149763 17360 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:54.150681 17360 heartbeater.cc:511] Master 127.19.155.254:36265 requested a full tablet report, sending...
I20260811 18:58:54.152967 16634 ts_manager.cc:194] Registered new tserver with Master: 46aeadf7a64f429c9bca32a7af6a4c3e (127.19.155.195:37871)
I20260811 18:58:54.154129 16634 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.195:45177
I20260811 18:58:54.154829 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:54.167228 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.160421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36200 (local address 127.19.155.254:36265)
0811 18:58:54.160727 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.160735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.161102 (+ 367us) server_negotiation.cc:407] Connection header received
0811 18:58:54.161408 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.161414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.161524 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.161648 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:54.162300 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.163110 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.164636 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.165066 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.165215 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.166414 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:54.166420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:54.166423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:54.166445 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:54.166481 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:54.166494 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:54.166598 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.166752 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.166865 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260811 18:58:54.171597 16634 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:54.179056 16634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:54.216253 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.200877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:36631 (local address 127.0.0.1:55512)
0811 18:58:54.205731 (+ 4854us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.205761 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.205905 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.208397 (+ 2492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.208402 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.208430 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:54.208945 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.208963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210838 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.210842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.213005 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.213023 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.215093 (+ 2070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.215100 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.215335 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.215396 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.215551 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.215794 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4715,"mutex_wait_us":110,"thread_start_us":5117,"threads_started":1}
I20260811 18:58:54.216495 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.194370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.19.155.194:34941)
0811 18:58:54.207284 (+ 12914us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.207292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.207321 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:58:54.207416 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.207429 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.207682 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.207911 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:54.208858 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210271 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.213694 (+ 3423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.215241 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.215416 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.215628 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.215948 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.216140 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12763,"thread_start_us":12524,"threads_started":1}
I20260811 18:58:54.216900 17391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.194239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:34941 (local address 127.0.0.1:32854)
0811 18:58:54.204965 (+ 10726us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.204999 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.205186 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.208190 (+ 3004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.208196 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.208223 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:54.208645 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.208660 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210442 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.210447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.213442 (+ 2995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.213461 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.215542 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.215549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.215734 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.215762 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.215877 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.216038 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10535,"mutex_wait_us":44,"thread_start_us":11210,"threads_started":1}
I20260811 18:58:54.216922 17386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.193326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:37871 (local address 127.0.0.1:43820)
0811 18:58:54.200285 (+ 6959us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.200341 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.200572 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.207609 (+ 7037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.207616 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.207659 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:54.208123 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.208142 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210830 (+ 2688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.210836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.213947 (+ 3111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.213961 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.215987 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.215994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.216210 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.216259 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.216330 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.216471 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6622,"mutex_wait_us":145,"thread_start_us":6428,"threads_started":1}
I20260811 18:58:54.217355 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.201285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55512 (local address 127.19.155.193:36631)
0811 18:58:54.207919 (+ 6634us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.207925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.207949 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:58:54.208024 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.208029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.208193 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.208405 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:54.209199 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210660 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.213270 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.214818 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.215085 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.215376 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.216770 (+ 1394us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.216979 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6465,"thread_start_us":6301,"threads_started":1}
I20260811 18:58:54.218855 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.193731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43820 (local address 127.19.155.195:37871)
0811 18:58:54.206756 (+ 13025us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.206769 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.206818 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:58:54.206974 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.206983 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.207302 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.208397 (+ 1095us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:54.208710 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.210646 (+ 1936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.214218 (+ 3572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.215754 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.216935 (+ 1181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.217179 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.217268 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.217455 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12824,"thread_start_us":12630,"threads_started":1}
I20260811 18:58:54.221984 16823 tablet_service.cc:1467] Processing CreateTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 (DEFAULT_TABLE table=test-table [id=a9426df38b604dd19c13a2021cb41ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:54.222018 17038 tablet_service.cc:1467] Processing CreateTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 (DEFAULT_TABLE table=test-table [id=a9426df38b604dd19c13a2021cb41ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:54.223400 16823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a8b1cad40f34b5abdcd947245ccc713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:54.223703 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a8b1cad40f34b5abdcd947245ccc713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:54.223171 17251 tablet_service.cc:1467] Processing CreateTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 (DEFAULT_TABLE table=test-table [id=a9426df38b604dd19c13a2021cb41ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:54.224655 17251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a8b1cad40f34b5abdcd947245ccc713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:54.237026 17393 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Bootstrap starting.
I20260811 18:58:54.241218 17393 tablet_bootstrap.cc:654] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:54.242508 17393 log.cc:824] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:54.243825 17396 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Bootstrap starting.
I20260811 18:58:54.245997 17395 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Bootstrap starting.
I20260811 18:58:54.249327 17393 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: No bootstrap required, opened a new log
I20260811 18:58:54.249670 17393 ts_tablet_manager.cc:1397] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260811 18:58:54.249840 17396 tablet_bootstrap.cc:654] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:54.250046 17395 tablet_bootstrap.cc:654] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:54.251276 17396 log.cc:824] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:54.251320 17395 log.cc:824] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:54.254599 17396 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: No bootstrap required, opened a new log
I20260811 18:58:54.254805 17395 tablet_bootstrap.cc:492] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: No bootstrap required, opened a new log
I20260811 18:58:54.255033 17396 ts_tablet_manager.cc:1397] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 18:58:54.255146 17395 ts_tablet_manager.cc:1397] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260811 18:58:54.261099 17393 raft_consensus.cc:348] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.261647 17393 raft_consensus.cc:374] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:54.261755 17393 raft_consensus.cc:729] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f445a97d5c5b484cb6ff2b96d816fdd6, State: Initialized, Role: FOLLOWER
I20260811 18:58:54.262488 17393 consensus_queue.cc:260] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.264376 17396 raft_consensus.cc:348] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.264793 17396 raft_consensus.cc:374] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:54.264919 17396 raft_consensus.cc:729] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b29419e21214476a6b25914c7a1cc79, State: Initialized, Role: FOLLOWER
I20260811 18:58:54.265627 17396 consensus_queue.cc:260] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.266366 17393 ts_tablet_manager.cc:1428] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260811 18:58:54.266179 17395 raft_consensus.cc:348] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.266680 17395 raft_consensus.cc:374] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:54.266795 17395 raft_consensus.cc:729] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46aeadf7a64f429c9bca32a7af6a4c3e, State: Initialized, Role: FOLLOWER
I20260811 18:58:54.267426 17155 heartbeater.cc:503] Master 127.19.155.254:36265 was elected leader, sending a full tablet report...
I20260811 18:58:54.267588 17395 consensus_queue.cc:260] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.268178 17396 ts_tablet_manager.cc:1428] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260811 18:58:54.269734 17360 heartbeater.cc:503] Master 127.19.155.254:36265 was elected leader, sending a full tablet report...
I20260811 18:58:54.270440 17395 ts_tablet_manager.cc:1428] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260811 18:58:54.347869 16934 tablet.cc:2369] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:54.350477 17156 tablet.cc:2369] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:54.380168 17361 tablet.cc:2369] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:54.538647 17404 raft_consensus.cc:482] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:54.539078 17404 raft_consensus.cc:504] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.540994 17404 leader_election.cc:288] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46aeadf7a64f429c9bca32a7af6a4c3e (127.19.155.195:37871), 5b29419e21214476a6b25914c7a1cc79 (127.19.155.194:34941)
I20260811 18:58:54.551121 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.541593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54771 (local address 127.19.155.194:34941)
0811 18:58:54.541892 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.541902 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.542676 (+ 774us) server_negotiation.cc:407] Connection header received
0811 18:58:54.542951 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.542959 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.543087 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.543183 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:54.543959 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.545065 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.548538 (+ 3473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.549832 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.550032 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.550112 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.550667 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.550811 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260811 18:58:54.551121 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.541458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:44247 (local address 127.19.155.195:37871)
0811 18:58:54.541712 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.541721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.542692 (+ 971us) server_negotiation.cc:407] Connection header received
0811 18:58:54.543030 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.543035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.543101 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.543192 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:54.544132 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.545188 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.548538 (+ 3350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.549848 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.550032 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.550112 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.550667 (+ 555us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.550812 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:58:54.551303 17410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.541595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:37871 (local address 127.19.155.193:44247)
0811 18:58:54.542573 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.542589 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.542752 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.543411 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.543417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.543457 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:54.543932 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.543943 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.545330 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.545337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.548231 (+ 2894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.548255 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.550095 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.550108 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.550388 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.550501 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.550614 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.550813 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"mutex_wait_us":299,"spinlock_wait_cycles":38656,"thread_start_us":613,"threads_started":1}
I20260811 18:58:54.551738 17408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.541377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:34941 (local address 127.19.155.193:54771)
0811 18:58:54.542499 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:54.542521 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:54.542709 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:54.543251 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:54.543256 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:54.543282 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:54.543779 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.543798 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.545214 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.545218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.548231 (+ 3013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:54.548255 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.550130 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.550137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:54.550394 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.550505 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 18:58:54.550614 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:58:54.550813 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"mutex_wait_us":364,"thread_start_us":609,"threads_started":1}
I20260811 18:58:54.552667 17284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a8b1cad40f34b5abdcd947245ccc713" candidate_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" is_pre_election: true
I20260811 18:58:54.552968 17075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a8b1cad40f34b5abdcd947245ccc713" candidate_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b29419e21214476a6b25914c7a1cc79" is_pre_election: true
I20260811 18:58:54.553229 17284 raft_consensus.cc:2454] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f445a97d5c5b484cb6ff2b96d816fdd6 in term 0.
I20260811 18:58:54.553526 17075 raft_consensus.cc:2454] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f445a97d5c5b484cb6ff2b96d816fdd6 in term 0.
I20260811 18:58:54.554005 16750 leader_election.cc:302] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46aeadf7a64f429c9bca32a7af6a4c3e, f445a97d5c5b484cb6ff2b96d816fdd6; no voters:
I20260811 18:58:54.554515 17404 raft_consensus.cc:2781] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:54.554713 17404 raft_consensus.cc:482] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:54.554836 17404 raft_consensus.cc:3037] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:54.557417 17404 raft_consensus.cc:504] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.558275 17404 leader_election.cc:288] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [CANDIDATE]: Term 1 election: Requested vote from peers 46aeadf7a64f429c9bca32a7af6a4c3e (127.19.155.195:37871), 5b29419e21214476a6b25914c7a1cc79 (127.19.155.194:34941)
I20260811 18:58:54.558871 17284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a8b1cad40f34b5abdcd947245ccc713" candidate_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e"
I20260811 18:58:54.558951 17075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a8b1cad40f34b5abdcd947245ccc713" candidate_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b29419e21214476a6b25914c7a1cc79"
I20260811 18:58:54.559178 17075 raft_consensus.cc:3037] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:54.559178 17284 raft_consensus.cc:3037] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:54.561736 17284 raft_consensus.cc:2454] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f445a97d5c5b484cb6ff2b96d816fdd6 in term 1.
I20260811 18:58:54.561767 17075 raft_consensus.cc:2454] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f445a97d5c5b484cb6ff2b96d816fdd6 in term 1.
I20260811 18:58:54.562271 16750 leader_election.cc:302] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46aeadf7a64f429c9bca32a7af6a4c3e, f445a97d5c5b484cb6ff2b96d816fdd6; no voters:
I20260811 18:58:54.562661 17404 raft_consensus.cc:2781] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:54.563236 17404 raft_consensus.cc:686] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 1 LEADER]: Becoming Leader. State: Replica: f445a97d5c5b484cb6ff2b96d816fdd6, State: Running, Role: LEADER
I20260811 18:58:54.563834 17404 consensus_queue.cc:237] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } }
I20260811 18:58:54.568938 16631 catalog_manager.cc:5495] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f445a97d5c5b484cb6ff2b96d816fdd6 (127.19.155.193). New cstate: current_term: 1 leader_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f445a97d5c5b484cb6ff2b96d816fdd6" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 } health_report { overall_health: UNKNOWN } } }
I20260811 18:58:54.589490 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.584075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55520 (local address 127.19.155.193:36631)
0811 18:58:54.584273 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.584279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.584298 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:58:54.584466 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.584470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.584571 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.584711 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:54.585069 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.585776 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.587316 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.587756 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.587859 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.588394 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:54.588957 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:54.589079 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.589192 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.589266 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:58:54.599210 17075 raft_consensus.cc:1261] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 1 FOLLOWER]: Refusing update from remote peer f445a97d5c5b484cb6ff2b96d816fdd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:54.599383 17284 raft_consensus.cc:1261] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 1 FOLLOWER]: Refusing update from remote peer f445a97d5c5b484cb6ff2b96d816fdd6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:54.600407 17411 consensus_queue.cc:1035] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46aeadf7a64f429c9bca32a7af6a4c3e" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 37871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:54.600859 17404 consensus_queue.cc:1035] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b29419e21214476a6b25914c7a1cc79" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:54.616489 17418 mvcc.cc:205] Tried to move back new op lower bound from 7317400512905023488 to 7317400512777969664. Current Snapshot: MvccSnapshot[applied={T|T < 7317400512905023488}]
I20260811 18:58:54.632476 16634 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:54.632827 16634 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:54.637192 16634 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22132c01dc7c401ca085235a44daf0d0: Sending DeleteTablet for 3 replicas of tablet 0a8b1cad40f34b5abdcd947245ccc713
I20260811 18:58:54.638665 16823 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:54 UTC) from {username='slave'} at 127.0.0.1:55512
I20260811 18:58:54.638652 17038 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:54 UTC) from {username='slave'} at 127.0.0.1:32854
I20260811 18:58:54.638731 17251 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a8b1cad40f34b5abdcd947245ccc713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:54 UTC) from {username='slave'} at 127.0.0.1:43820
I20260811 18:58:54.641109 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 16716
I20260811 18:58:54.654480 17445 tablet_replica.cc:330] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: stopping tablet replica
I20260811 18:58:54.654603 17439 tablet_replica.cc:330] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: stopping tablet replica
I20260811 18:58:54.655419 17445 raft_consensus.cc:2229] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:54.655469 17443 tablet_replica.cc:330] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: stopping tablet replica
I20260811 18:58:54.655933 17443 raft_consensus.cc:2229] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:54.656193 17445 raft_consensus.cc:2258] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:54.657080 17439 raft_consensus.cc:2229] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:54.657636 17439 raft_consensus.cc:2258] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:54.658142 17443 raft_consensus.cc:2258] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:54.659340 17445 ts_tablet_manager.cc:1905] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:54.661638 17439 ts_tablet_manager.cc:1905] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:54.662984 17443 ts_tablet_manager.cc:1905] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:54.667814 17445 ts_tablet_manager.cc:1918] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:54.668089 17445 log.cc:1196] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/0a8b1cad40f34b5abdcd947245ccc713
I20260811 18:58:54.668741 17445 ts_tablet_manager.cc:1939] T 0a8b1cad40f34b5abdcd947245ccc713 P 46aeadf7a64f429c9bca32a7af6a4c3e: Deleting consensus metadata
I20260811 18:58:54.668910 17439 ts_tablet_manager.cc:1918] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:54.669100 17439 log.cc:1196] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/0a8b1cad40f34b5abdcd947245ccc713
I20260811 18:58:54.669657 17439 ts_tablet_manager.cc:1939] T 0a8b1cad40f34b5abdcd947245ccc713 P 5b29419e21214476a6b25914c7a1cc79: Deleting consensus metadata
I20260811 18:58:54.670867 17443 ts_tablet_manager.cc:1918] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:54.671090 17443 log.cc:1196] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/0a8b1cad40f34b5abdcd947245ccc713
I20260811 18:58:54.671379 16609 catalog_manager.cc:4841] TS 46aeadf7a64f429c9bca32a7af6a4c3e (127.19.155.195:37871): tablet 0a8b1cad40f34b5abdcd947245ccc713 (table test-table [id=a9426df38b604dd19c13a2021cb41ecd]) successfully deleted
I20260811 18:58:54.671535 16607 catalog_manager.cc:4841] TS 5b29419e21214476a6b25914c7a1cc79 (127.19.155.194:34941): tablet 0a8b1cad40f34b5abdcd947245ccc713 (table test-table [id=a9426df38b604dd19c13a2021cb41ecd]) successfully deleted
I20260811 18:58:54.671752 17443 ts_tablet_manager.cc:1939] T 0a8b1cad40f34b5abdcd947245ccc713 P f445a97d5c5b484cb6ff2b96d816fdd6: Deleting consensus metadata
I20260811 18:58:54.673254 16609 catalog_manager.cc:4841] TS f445a97d5c5b484cb6ff2b96d816fdd6 (127.19.155.193:36631): tablet 0a8b1cad40f34b5abdcd947245ccc713 (table test-table [id=a9426df38b604dd19c13a2021cb41ecd]) successfully deleted
I20260811 18:58:54.675524 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.642304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.19.155.193:36631)
0811 18:58:54.642555 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.642562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.655905 (+ 13343us) server_negotiation.cc:407] Connection header received
0811 18:58:54.656242 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.656247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.656378 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.656465 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:54.657228 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.658480 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.660591 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.661265 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.661388 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.673686 (+ 12298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:54.673699 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:54.673725 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:54.674584 (+ 859us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:54.674652 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:54.674682 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:54.674822 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.674996 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.675119 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 18:58:54.676285 16920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:54.776979 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 16716
I20260811 18:58:54.803416 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 16942
I20260811 18:58:54.810776 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.804251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32866 (local address 127.19.155.194:34941)
0811 18:58:54.804457 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.804464 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.804486 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:58:54.804692 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.804701 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.804791 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.804917 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:54.805341 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.806104 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.807502 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.807943 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.808091 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.809212 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:54.809222 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:54.809240 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:54.809901 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:54.809960 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:54.809981 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:54.810124 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.810273 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.810404 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:58:54.811720 17147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:54.908744 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 16942
I20260811 18:58:54.937367 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 17161
I20260811 18:58:54.945094 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:54.938263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43822 (local address 127.19.155.195:37871)
0811 18:58:54.938479 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:54.938485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:54.938507 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:58:54.938686 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:54.938691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:54.938786 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:54.938928 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:54.939392 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.940120 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.941506 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:54.942080 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:54.942223 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:54.943436 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:54.943452 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:54.943469 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:58:54.944208 (+ 739us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:54.944263 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:58:54.944288 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:54.944438 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:54.944605 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 18:58:54.944729 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 18:58:54.945840 17352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:55.035619 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 17161
I20260811 18:58:55.071359 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 16581
I20260811 18:58:55.072538 16676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:55.184655 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 16581
2026-08-11T18:58:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3283 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:58:55 dist-test-slave-1nl6 krb5kdc[17456](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:58:55 dist-test-slave-1nl6 krb5kdc[17456](info): set up 2 sockets
Aug 11 18:58:55 dist-test-slave-1nl6 krb5kdc[17456](info): commencing operation
krb5kdc: starting...
W20260811 18:58:56.578637 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.001s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:58:56 dist-test-slave-1nl6 krb5kdc[17456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:58:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:58:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:58:56.916145 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36105
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:36105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:57.289324 17481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:57.289682 17481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:57.289778 17481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:57.297348 17481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:58:57.297494 17481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:57.297544 17481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:57.297598 17481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:58:57.297645 17481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:58:57.307969 17481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:36105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:36105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:57.309551 17481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:57.310876 17481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:57.324231 17494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:57.324178 17492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:57.324203 17501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:57.325254 17481 server_base.cc:1034] running on GCE node
I20260811 18:58:57.326185 17481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:57.327919 17481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:57.329203 17481 hybrid_clock.cc:648] HybridClock initialized: now 1786474737329131 us; error 60 us; skew 500 ppm
I20260811 18:58:57.329599 17481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:57 dist-test-slave-1nl6 krb5kdc[17456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474737, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:57.333103 17481 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:58:57.334820 17481 webserver.cc:460] Webserver started at http://127.19.155.254:36695/ using document root <none> and password file <none>
I20260811 18:58:57.335623 17481 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:57.335795 17481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:57.336140 17481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:57.339520 17481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "c4772b72160946b599a531abe119ab37"
format_stamp: "Formatted at 2026-08-11 18:58:57 on dist-test-slave-1nl6"
server_key: "097d677756196bfc30ebcdaf329afced"
server_key_iv: "f1f2e064312aaedd027b496708c7f6b8"
server_key_version: "encryptionkey@0"
I20260811 18:58:57.340386 17481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "c4772b72160946b599a531abe119ab37"
format_stamp: "Formatted at 2026-08-11 18:58:57 on dist-test-slave-1nl6"
server_key: "097d677756196bfc30ebcdaf329afced"
server_key_iv: "f1f2e064312aaedd027b496708c7f6b8"
server_key_version: "encryptionkey@0"
I20260811 18:58:57.346400 17481 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 18:58:57.351015 17513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:57.352694 17481 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 18:58:57.352947 17481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "c4772b72160946b599a531abe119ab37"
format_stamp: "Formatted at 2026-08-11 18:58:57 on dist-test-slave-1nl6"
server_key: "097d677756196bfc30ebcdaf329afced"
server_key_iv: "f1f2e064312aaedd027b496708c7f6b8"
server_key_version: "encryptionkey@0"
I20260811 18:58:57.353217 17481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:57.378633 17481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:57.383442 17481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:57.383790 17481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:57.404214 17481 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:36105
I20260811 18:58:57.404234 17594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:36105 every 8 connection(s)
I20260811 18:58:57.405797 17481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:58:57.410081 17595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:57.410715 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 17481
I20260811 18:58:57.410964 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:58:57.411459 20079 external_mini_cluster.cc:1428] Setting key 23574d5d7c3341d61ac1e78518b0d6c7
I20260811 18:58:57.426041 17595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: Bootstrap starting.
Aug 11 18:58:57 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:57.429800 17595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:57.431492 17595 log.cc:824] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:57.435804 17595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: No bootstrap required, opened a new log
I20260811 18:58:57.440490 17601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:57.413606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.19.155.254:36105)
0811 18:58:57.414550 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:57.414572 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:57.414637 (+ 65us) server_negotiation.cc:407] Connection header received
0811 18:58:57.417460 (+ 2823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:57.417502 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:57.418204 (+ 702us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:57.418745 (+ 541us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:57.420396 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:57.422518 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:57.424048 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:57.425161 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:57.425354 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:57.430106 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:57.430120 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:57.430143 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:57.430212 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:57.434706 (+ 4494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:57.435776 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:57.435787 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:57.435797 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:57.436047 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:57.436517 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:57.436523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:57.436527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:57.437363 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:57.437722 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:57.438284 (+ 562us) server_negotiation.cc:299] Negotiation successful
0811 18:58:57.438849 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":370,"threads_started":1}
I20260811 18:58:57.446264 17595 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } }
I20260811 18:58:57.446700 17595 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:57.446782 17595 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4772b72160946b599a531abe119ab37, State: Initialized, Role: FOLLOWER
I20260811 18:58:57.447479 17595 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } }
I20260811 18:58:57.447762 17595 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:58:57.447934 17595 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:58:57.448151 17595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:57.450771 17595 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } }
I20260811 18:58:57.451431 17595 leader_election.cc:302] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4772b72160946b599a531abe119ab37; no voters:
I20260811 18:58:57.452153 17595 leader_election.cc:288] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:58:57.452315 17604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:57.453128 17604 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [term 1 LEADER]: Becoming Leader. State: Replica: c4772b72160946b599a531abe119ab37, State: Running, Role: LEADER
I20260811 18:58:57.453862 17604 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } }
I20260811 18:58:57.454819 17595 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:58:57.457312 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4772b72160946b599a531abe119ab37. Latest consensus state: current_term: 1 leader_uuid: "c4772b72160946b599a531abe119ab37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } } }
I20260811 18:58:57.457278 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4772b72160946b599a531abe119ab37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4772b72160946b599a531abe119ab37" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 36105 } } }
I20260811 18:58:57.457794 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:57.457794 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37 [sys.catalog]: This master's current role is: LEADER
I20260811 18:58:57.469578 17610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:58:57.475248 17610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:58:57.485922 17610 catalog_manager.cc:1347] Generated new cluster ID: 91fdd6100cd7444dae32d192455eb54b
I20260811 18:58:57.486169 17610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:58:57.505158 17610 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:58:57.506659 17610 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:58:57.514035 17610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: Generated new TSK 0
I20260811 18:58:57.515082 17610 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:58:57.593904 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:57.979364 17636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:57.979697 17636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:57.979797 17636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:57.987587 17636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:57.987722 17636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:57.987841 17636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:58:57.998188 17636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:57.999639 17636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:58.001025 17636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:58.015172 17641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:58.015177 17647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:58.015756 17643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:58.016336 17636 server_base.cc:1034] running on GCE node
I20260811 18:58:58.017012 17636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:58.018038 17636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:58.019243 17636 hybrid_clock.cc:648] HybridClock initialized: now 1786474738019197 us; error 32 us; skew 500 ppm
I20260811 18:58:58.019593 17636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:58 dist-test-slave-1nl6 krb5kdc[17456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474738, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:58.022835 17636 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:58:58.024351 17636 webserver.cc:460] Webserver started at http://127.19.155.193:39121/ using document root <none> and password file <none>
I20260811 18:58:58.025054 17636 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:58.025210 17636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:58.025557 17636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:58.028851 17636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "e047ea14c4d54b05b6c005b3f1bdb82b"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "9745dc70a208f58726c61c05b032404f"
server_key_iv: "5ebcdbae228491cb0ee77d6069bdd537"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.029744 17636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "e047ea14c4d54b05b6c005b3f1bdb82b"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "9745dc70a208f58726c61c05b032404f"
server_key_iv: "5ebcdbae228491cb0ee77d6069bdd537"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.035840 17636 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 18:58:58.040102 17659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.041697 17636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:58:58.041953 17636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "e047ea14c4d54b05b6c005b3f1bdb82b"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "9745dc70a208f58726c61c05b032404f"
server_key_iv: "5ebcdbae228491cb0ee77d6069bdd537"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.042241 17636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:58.056679 17636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:58.061372 17636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:58.061714 17636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:58.063082 17636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:58.064791 17636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:58.064904 17636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.065044 17636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:58.065126 17636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.102988 17636 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:43953
I20260811 18:58:58.103058 17849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:43953 every 8 connection(s)
I20260811 18:58:58.104507 17636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:58:58.109532 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 17636
I20260811 18:58:58.109750 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:58:58.110348 20079 external_mini_cluster.cc:1428] Setting key bd6ff65a8822dfad0cec362f9a186a65
Aug 11 18:58:58 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474738, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:58.129387 17852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:58.107423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:46025 (local address 127.19.155.254:36105)
0811 18:58:58.107922 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:58.107930 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:58.108994 (+ 1064us) server_negotiation.cc:407] Connection header received
0811 18:58:58.111692 (+ 2698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:58.111698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:58.111788 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:58.111917 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:58.114081 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.114850 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.117532 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.117972 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.118087 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:58.122871 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:58.122877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:58.122880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:58.122978 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:58.125801 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:58.126717 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:58.126724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:58.126729 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:58.126877 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:58.127417 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:58.127423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:58.127427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:58.127740 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:58.127908 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:58.128722 (+ 814us) server_negotiation.cc:299] Negotiation successful
0811 18:58:58.128987 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":233,"threads_started":1}
I20260811 18:58:58.130523 17853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:58.108020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36105 (local address 127.19.155.193:46025)
0811 18:58:58.108802 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:58.108851 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:58.111356 (+ 2505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:58.112144 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:58.112153 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:58.112978 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:58.113859 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:58.113890 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.115082 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.115090 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:58.117348 (+ 2258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:58.117367 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.118231 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.118241 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:58.118588 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:58.119545 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:58.119583 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:58.122555 (+ 2972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:58.126006 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:58.126018 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:58.126047 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:58.126557 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:58.127034 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:58.127040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:58.127044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:58.127284 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:58.127898 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:58.127907 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:58.128313 (+ 406us) client_negotiation.cc:769] Sending connection context
0811 18:58:58.128612 (+ 299us) client_negotiation.cc:240] Negotiation successful
0811 18:58:58.129255 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":315,"threads_started":1}
I20260811 18:58:58.132507 17850 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36105
I20260811 18:58:58.132893 17850 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:58.133739 17850 heartbeater.cc:511] Master 127.19.155.254:36105 requested a full tablet report, sending...
I20260811 18:58:58.136811 17538 ts_manager.cc:194] Registered new tserver with Master: e047ea14c4d54b05b6c005b3f1bdb82b (127.19.155.193:43953)
I20260811 18:58:58.139161 17538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:46025
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:58:58.190012 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:58.552034 17863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:58.552421 17863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:58.552593 17863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:58.560527 17863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:58.560726 17863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:58.560910 17863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:58:58.572284 17863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:58.573906 17863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:58.575505 17863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:58.591028 17872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:58.591055 17870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:58.591113 17874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:58.591884 17863 server_base.cc:1034] running on GCE node
I20260811 18:58:58.592547 17863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:58.593555 17863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:58.594810 17863 hybrid_clock.cc:648] HybridClock initialized: now 1786474738594764 us; error 48 us; skew 500 ppm
I20260811 18:58:58.595217 17863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:58 dist-test-slave-1nl6 krb5kdc[17456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474738, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:58.598713 17863 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:58:58.600488 17863 webserver.cc:460] Webserver started at http://127.19.155.194:32797/ using document root <none> and password file <none>
I20260811 18:58:58.601315 17863 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:58.601483 17863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:58.601850 17863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:58.605218 17863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "28850e511637418795b65a71b356ffb9"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "e1cff6e888e4f7c9dffb95e9b003aafc"
server_key_iv: "6ad5541c8bcc1bf310da53e5de21ae39"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.606132 17863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "28850e511637418795b65a71b356ffb9"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "e1cff6e888e4f7c9dffb95e9b003aafc"
server_key_iv: "6ad5541c8bcc1bf310da53e5de21ae39"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.612075 17863 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 18:58:58.615971 17891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.617462 17863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:58:58.617667 17863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "28850e511637418795b65a71b356ffb9"
format_stamp: "Formatted at 2026-08-11 18:58:58 on dist-test-slave-1nl6"
server_key: "e1cff6e888e4f7c9dffb95e9b003aafc"
server_key_iv: "6ad5541c8bcc1bf310da53e5de21ae39"
server_key_version: "encryptionkey@0"
I20260811 18:58:58.617913 17863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:58.636479 17863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:58.640861 17863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:58.641191 17863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:58.642232 17863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:58.643675 17863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:58.643787 17863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.643949 17863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:58.644025 17863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:58.680192 17863 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:37597
I20260811 18:58:58.680235 18074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:37597 every 8 connection(s)
I20260811 18:58:58.681643 17863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:58:58.685866 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 17863
I20260811 18:58:58.686074 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:58:58.686594 20079 external_mini_cluster.cc:1428] Setting key cbe5dcc2a2cedde3f5d1bfc39a2980d6
Aug 11 18:58:58 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474738, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:58.705786 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:58.684470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:51781 (local address 127.19.155.254:36105)
0811 18:58:58.685016 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:58.685023 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:58.685994 (+ 971us) server_negotiation.cc:407] Connection header received
0811 18:58:58.688275 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:58.688281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:58.688420 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:58.688535 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:58.690507 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.691776 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.693500 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.694248 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.694402 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:58.698362 (+ 3960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:58.698371 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:58.698379 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:58.698431 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:58.702202 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:58.703095 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:58.703103 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:58.703109 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:58.703310 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:58.703881 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:58.703884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:58.703886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:58.704163 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:58.704288 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:58.705305 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 18:58:58.705494 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":243,"threads_started":1}
I20260811 18:58:58.707427 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:58.684943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36105 (local address 127.19.155.194:51781)
0811 18:58:58.685792 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:58.685842 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:58.687956 (+ 2114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:58.688972 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:58.688985 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:58.689632 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:58.690271 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:58.690291 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.691976 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.691980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:58.693315 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:58.693328 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:58.694500 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:58.694506 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:58.694718 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:58.695531 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:58.695561 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:58.698079 (+ 2518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:58.702396 (+ 4317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:58.702404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:58.702420 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:58.702895 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:58.703453 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:58.703461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:58.703465 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:58.703755 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:58.704312 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:58.704322 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:58.704842 (+ 520us) client_negotiation.cc:769] Sending connection context
0811 18:58:58.705194 (+ 352us) client_negotiation.cc:240] Negotiation successful
0811 18:58:58.705839 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":331,"threads_started":1}
I20260811 18:58:58.709133 18075 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36105
I20260811 18:58:58.709491 18075 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:58.710295 18075 heartbeater.cc:511] Master 127.19.155.254:36105 requested a full tablet report, sending...
I20260811 18:58:58.711977 17538 ts_manager.cc:194] Registered new tserver with Master: 28850e511637418795b65a71b356ffb9 (127.19.155.194:37597)
I20260811 18:58:58.712873 17538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:51781
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:58:58.762441 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:36085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:58:59.133365 18082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:58:59.133764 18082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:58:59.133947 18082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:58:59.141644 18082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:58:59.141837 18082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:58:59.142021 18082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:58:59.144932 17850 heartbeater.cc:503] Master 127.19.155.254:36105 was elected leader, sending a full tablet report...
I20260811 18:58:59.153039 18082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:36105
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:58:59.154572 18082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:58:59.156136 18082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:58:59.170739 18091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:59.170629 18095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:58:59.170804 18092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:58:59.171814 18082 server_base.cc:1034] running on GCE node
I20260811 18:58:59.172482 18082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:58:59.173497 18082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:58:59.174734 18082 hybrid_clock.cc:648] HybridClock initialized: now 1786474739174658 us; error 64 us; skew 500 ppm
I20260811 18:58:59.175153 18082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:58:59 dist-test-slave-1nl6 krb5kdc[17456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474739, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:58:59.183435 18082 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:58:59.185310 18082 webserver.cc:460] Webserver started at http://127.19.155.195:38413/ using document root <none> and password file <none>
I20260811 18:58:59.186110 18082 fs_manager.cc:359] Metadata directory not provided
I20260811 18:58:59.186285 18082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:58:59.186651 18082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:58:59.190207 18082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "de005a8d350441cf80b4cd392d7389af"
format_stamp: "Formatted at 2026-08-11 18:58:59 on dist-test-slave-1nl6"
server_key: "a17e1bf06cec6dacd6efb97c8498e37a"
server_key_iv: "7fcbbedde14499fec1207c559dcfb0cd"
server_key_version: "encryptionkey@0"
I20260811 18:58:59.191274 18082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "de005a8d350441cf80b4cd392d7389af"
format_stamp: "Formatted at 2026-08-11 18:58:59 on dist-test-slave-1nl6"
server_key: "a17e1bf06cec6dacd6efb97c8498e37a"
server_key_iv: "7fcbbedde14499fec1207c559dcfb0cd"
server_key_version: "encryptionkey@0"
I20260811 18:58:59.197741 18082 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:58:59.201884 18107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:59.203552 18082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:58:59.203786 18082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "de005a8d350441cf80b4cd392d7389af"
format_stamp: "Formatted at 2026-08-11 18:58:59 on dist-test-slave-1nl6"
server_key: "a17e1bf06cec6dacd6efb97c8498e37a"
server_key_iv: "7fcbbedde14499fec1207c559dcfb0cd"
server_key_version: "encryptionkey@0"
I20260811 18:58:59.204030 18082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:58:59.229856 18082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:58:59.235035 18082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:58:59.235383 18082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:58:59.236557 18082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:58:59.238250 18082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:58:59.238361 18082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:59.238524 18082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:58:59.238602 18082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:58:59.275498 18082 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:42683
I20260811 18:58:59.275563 18282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:42683 every 8 connection(s)
I20260811 18:58:59.276976 18082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:58:59.278548 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 18082
I20260811 18:58:59.278771 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:58:59.279383 20079 external_mini_cluster.cc:1428] Setting key 8b5431da46c64786fcc59356aeb2c950
Aug 11 18:58:59 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474739, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:58:59.299870 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.279885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:48003 (local address 127.19.155.254:36105)
0811 18:58:59.280536 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.280544 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.281955 (+ 1411us) server_negotiation.cc:407] Connection header received
0811 18:58:59.284144 (+ 2189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.284149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.284228 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.284320 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:59.285911 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.286696 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.288362 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.288768 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.288867 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.292969 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:59.292975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:59.292979 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:59.293022 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:59.296618 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.297497 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.297501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.297504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.297644 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.298079 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.298082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.298084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.298356 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:59.298483 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.299344 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.299555 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":337,"threads_started":1}
I20260811 18:58:59.301098 18287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.280602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:36105 (local address 127.19.155.195:48003)
0811 18:58:59.281759 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.281818 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.283859 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.284520 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.284528 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.285121 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:58:59.285744 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.285764 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.286838 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.286842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.288211 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.288225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.288973 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.288978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.289190 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.289984 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:58:59.290010 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:58:59.292662 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:58:59.296808 (+ 4146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:59.296818 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:59.296834 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:59.297364 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:59.297752 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:58:59.297755 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:58:59.297758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:58:59.297972 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:58:59.298475 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:58:59.298481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:58:59.298855 (+ 374us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.299215 (+ 360us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.299810 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":623,"threads_started":1}
I20260811 18:58:59.302767 18284 heartbeater.cc:347] Connected to a master server at 127.19.155.254:36105
I20260811 18:58:59.303180 18284 heartbeater.cc:464] Registering TS with master...
I20260811 18:58:59.303990 18284 heartbeater.cc:511] Master 127.19.155.254:36105 requested a full tablet report, sending...
I20260811 18:58:59.305696 17538 ts_manager.cc:194] Registered new tserver with Master: de005a8d350441cf80b4cd392d7389af (127.19.155.195:42683)
I20260811 18:58:59.306854 17538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:48003
I20260811 18:58:59.308914 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:58:59.327860 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.313395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.19.155.254:36105)
0811 18:58:59.313591 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.313596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.314108 (+ 512us) server_negotiation.cc:407] Connection header received
0811 18:58:59.314250 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.314255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.314349 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.314442 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:59.316051 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.316840 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.318263 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.318691 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.318800 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.321918 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:59.321927 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:59.321931 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:59.321974 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:59.325034 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.325954 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.325958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.325960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.326095 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.326509 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.326512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.326514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.326836 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:59.327145 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.327463 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.327619 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 18:58:59.332504 17538 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:58:59.339979 17538 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:58:59.381585 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.354265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59706 (local address 127.19.155.195:42683)
0811 18:58:59.368266 (+ 14001us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.368280 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.369599 (+ 1319us) server_negotiation.cc:407] Connection header received
0811 18:58:59.370183 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.370198 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.370568 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.370796 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:59.372983 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.375294 (+ 2311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.378772 (+ 3478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.380243 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.380479 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.380707 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.380994 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.381198 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13708,"thread_start_us":14049,"threads_started":1}
I20260811 18:58:59.381747 18301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.353905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:42683 (local address 127.0.0.1:59706)
0811 18:58:59.369332 (+ 15427us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.369395 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.369852 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.371744 (+ 1892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.371756 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.371824 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:59.372648 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.372677 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.375576 (+ 2899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.375584 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.378518 (+ 2934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.378536 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.380480 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.380486 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.380696 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.380764 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.380938 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.381250 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15047,"mutex_wait_us":83,"thread_start_us":14858,"threads_started":1}
I20260811 18:58:59.382725 18309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.354274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:37597 (local address 127.0.0.1:46808)
0811 18:58:59.372177 (+ 17903us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.372210 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.372420 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.374578 (+ 2158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.374583 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.374610 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:59.375175 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.375192 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.376667 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.376675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.379597 (+ 2922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.379613 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.381929 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.381934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.382147 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.382196 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.382291 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.382441 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17678,"mutex_wait_us":69,"thread_start_us":22431,"threads_started":1}
I20260811 18:58:59.383104 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.354839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46808 (local address 127.19.155.194:37597)
0811 18:58:59.373525 (+ 18686us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.373530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.373592 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:58:59.373719 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.373728 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.374045 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.374304 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:59.375431 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.376497 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.379829 (+ 3332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.381453 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.381640 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.381824 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.382416 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.382607 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18554,"thread_start_us":18469,"threads_started":1}
I20260811 18:58:59.387461 18302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.354866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:43953 (local address 127.0.0.1:35818)
0811 18:58:59.376590 (+ 21724us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.376614 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.376904 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.377820 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.377825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.377854 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:59.378699 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.378714 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.380768 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.380775 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.384157 (+ 3382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.384175 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.386480 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.386487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.386662 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.386697 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.386835 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.387015 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21544,"mutex_wait_us":4,"thread_start_us":16177,"threads_started":1}
I20260811 18:58:59.387456 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.355395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.19.155.193:43953)
0811 18:58:59.373139 (+ 17744us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.373154 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.376750 (+ 3596us) server_negotiation.cc:407] Connection header received
0811 18:58:59.377212 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.377222 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.377555 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.377821 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:59.378941 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.380582 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.384363 (+ 3781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.386226 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.386479 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.386686 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.386893 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.387138 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17551,"thread_start_us":17386,"threads_started":1}
I20260811 18:58:59.387032 18184 tablet_service.cc:1467] Processing CreateTablet for tablet 973a9ac8df854285b2eaf05164119a8d (DEFAULT_TABLE table=test-table [id=31042607cfd1427a9a370e8ebd913513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:59.388944 18184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973a9ac8df854285b2eaf05164119a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:59.388777 17967 tablet_service.cc:1467] Processing CreateTablet for tablet 973a9ac8df854285b2eaf05164119a8d (DEFAULT_TABLE table=test-table [id=31042607cfd1427a9a370e8ebd913513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:59.393630 17742 tablet_service.cc:1467] Processing CreateTablet for tablet 973a9ac8df854285b2eaf05164119a8d (DEFAULT_TABLE table=test-table [id=31042607cfd1427a9a370e8ebd913513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:58:59.395004 17967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973a9ac8df854285b2eaf05164119a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:59.395306 17742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973a9ac8df854285b2eaf05164119a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:58:59.411319 18310 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Bootstrap starting.
I20260811 18:58:59.418082 18314 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Bootstrap starting.
I20260811 18:58:59.419453 18310 tablet_bootstrap.cc:654] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:59.420912 18310 log.cc:824] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:59.422374 18313 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Bootstrap starting.
I20260811 18:58:59.424220 18314 tablet_bootstrap.cc:654] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:59.425762 18314 log.cc:824] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:59.426440 18313 tablet_bootstrap.cc:654] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Neither blocks nor log segments found. Creating new log.
I20260811 18:58:59.427996 18313 log.cc:824] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:58:59.430022 18310 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: No bootstrap required, opened a new log
I20260811 18:58:59.430477 18310 ts_tablet_manager.cc:1397] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.004s
I20260811 18:58:59.431774 18314 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: No bootstrap required, opened a new log
I20260811 18:58:59.432149 18314 ts_tablet_manager.cc:1397] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260811 18:58:59.437261 18313 tablet_bootstrap.cc:492] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: No bootstrap required, opened a new log
I20260811 18:58:59.437633 18313 ts_tablet_manager.cc:1397] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260811 18:58:59.440726 18314 raft_consensus.cc:348] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.441197 18314 raft_consensus.cc:374] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:59.441359 18314 raft_consensus.cc:729] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e047ea14c4d54b05b6c005b3f1bdb82b, State: Initialized, Role: FOLLOWER
I20260811 18:58:59.442082 18314 consensus_queue.cc:260] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.442452 18310 raft_consensus.cc:348] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.443046 18310 raft_consensus.cc:374] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:59.443197 18310 raft_consensus.cc:729] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de005a8d350441cf80b4cd392d7389af, State: Initialized, Role: FOLLOWER
I20260811 18:58:59.443966 18310 consensus_queue.cc:260] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.445927 18314 ts_tablet_manager.cc:1428] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Time spent starting tablet: real 0.014s user 0.010s sys 0.000s
I20260811 18:58:59.447147 18284 heartbeater.cc:503] Master 127.19.155.254:36105 was elected leader, sending a full tablet report...
I20260811 18:58:59.448002 18310 ts_tablet_manager.cc:1428] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Time spent starting tablet: real 0.017s user 0.011s sys 0.005s
I20260811 18:58:59.449713 18313 raft_consensus.cc:348] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.450325 18313 raft_consensus.cc:374] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:58:59.450439 18313 raft_consensus.cc:729] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28850e511637418795b65a71b356ffb9, State: Initialized, Role: FOLLOWER
I20260811 18:58:59.451190 18313 consensus_queue.cc:260] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.452432 18075 heartbeater.cc:503] Master 127.19.155.254:36105 was elected leader, sending a full tablet report...
I20260811 18:58:59.453370 18313 ts_tablet_manager.cc:1428] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Time spent starting tablet: real 0.016s user 0.008s sys 0.008s
W20260811 18:58:59.528865 18285 tablet.cc:2369] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:58:59.607357 17851 tablet.cc:2369] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:59.629204 18319 raft_consensus.cc:482] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:58:59.629591 18319 raft_consensus.cc:504] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.631879 18319 leader_election.cc:288] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de005a8d350441cf80b4cd392d7389af (127.19.155.195:42683), 28850e511637418795b65a71b356ffb9 (127.19.155.194:37597)
I20260811 18:58:59.639289 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.632454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:56407 (local address 127.19.155.195:42683)
0811 18:58:59.632716 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.632726 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.633578 (+ 852us) server_negotiation.cc:407] Connection header received
0811 18:58:59.633770 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.633773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.633863 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.633958 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:59.634681 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.635523 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.637385 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.638171 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.638371 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.638450 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.638874 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.639027 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 18:58:59.639294 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.632660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:36133 (local address 127.19.155.194:37597)
0811 18:58:59.632924 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.632933 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.633478 (+ 545us) server_negotiation.cc:407] Connection header received
0811 18:58:59.633700 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.633708 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.633791 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.633862 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:58:59.634501 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.635349 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.637343 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.638152 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.638331 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.638430 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.638839 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.639003 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:58:59.639501 18323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.632201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:37597 (local address 127.19.155.193:36133)
0811 18:58:59.633323 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.633345 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.633500 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.633910 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.633916 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.633946 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:59.634332 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.634345 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.635484 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.635489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.637162 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.637177 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.638401 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.638408 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.638588 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.638676 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.638769 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.638975 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"mutex_wait_us":45,"thread_start_us":733,"threads_started":1}
I20260811 18:58:59.639626 18324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.632368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:42683 (local address 127.19.155.193:56407)
0811 18:58:59.633408 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0811 18:58:59.633451 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:58:59.633625 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:58:59.634004 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:58:59.634014 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:58:59.634076 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:58:59.634503 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.634515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.635681 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.635690 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.637170 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:58:59.637192 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.638443 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.638452 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:58:59.638632 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.638704 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 18:58:59.638821 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 18:58:59.638979 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"mutex_wait_us":46,"spinlock_wait_cycles":1920,"thread_start_us":739,"threads_started":1}
I20260811 18:58:59.640913 17996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973a9ac8df854285b2eaf05164119a8d" candidate_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28850e511637418795b65a71b356ffb9" is_pre_election: true
I20260811 18:58:59.640913 18211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973a9ac8df854285b2eaf05164119a8d" candidate_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de005a8d350441cf80b4cd392d7389af" is_pre_election: true
I20260811 18:58:59.641556 18211 raft_consensus.cc:2454] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e047ea14c4d54b05b6c005b3f1bdb82b in term 0.
I20260811 18:58:59.641556 17996 raft_consensus.cc:2454] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e047ea14c4d54b05b6c005b3f1bdb82b in term 0.
I20260811 18:58:59.642453 17662 leader_election.cc:302] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 28850e511637418795b65a71b356ffb9, de005a8d350441cf80b4cd392d7389af, e047ea14c4d54b05b6c005b3f1bdb82b; no voters:
I20260811 18:58:59.642962 18319 raft_consensus.cc:2781] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:58:59.643136 18319 raft_consensus.cc:482] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:58:59.643266 18319 raft_consensus.cc:3037] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:59.645545 18319 raft_consensus.cc:504] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.646289 18319 leader_election.cc:288] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [CANDIDATE]: Term 1 election: Requested vote from peers de005a8d350441cf80b4cd392d7389af (127.19.155.195:42683), 28850e511637418795b65a71b356ffb9 (127.19.155.194:37597)
I20260811 18:58:59.646766 17996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973a9ac8df854285b2eaf05164119a8d" candidate_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28850e511637418795b65a71b356ffb9"
I20260811 18:58:59.646816 18211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973a9ac8df854285b2eaf05164119a8d" candidate_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de005a8d350441cf80b4cd392d7389af"
I20260811 18:58:59.647061 17996 raft_consensus.cc:3037] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:59.647089 18211 raft_consensus.cc:3037] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:58:59.649520 18211 raft_consensus.cc:2454] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e047ea14c4d54b05b6c005b3f1bdb82b in term 1.
I20260811 18:58:59.649521 17996 raft_consensus.cc:2454] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e047ea14c4d54b05b6c005b3f1bdb82b in term 1.
I20260811 18:58:59.650103 17662 leader_election.cc:302] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28850e511637418795b65a71b356ffb9, e047ea14c4d54b05b6c005b3f1bdb82b; no voters:
I20260811 18:58:59.650471 18319 raft_consensus.cc:2781] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:58:59.651026 18319 raft_consensus.cc:686] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 1 LEADER]: Becoming Leader. State: Replica: e047ea14c4d54b05b6c005b3f1bdb82b, State: Running, Role: LEADER
I20260811 18:58:59.651654 18319 consensus_queue.cc:237] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } }
I20260811 18:58:59.656833 17535 catalog_manager.cc:5495] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b reported cstate change: term changed from 0 to 1, leader changed from <none> to e047ea14c4d54b05b6c005b3f1bdb82b (127.19.155.193). New cstate: current_term: 1 leader_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e047ea14c4d54b05b6c005b3f1bdb82b" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 43953 } health_report { overall_health: HEALTHY } } }
W20260811 18:58:59.683987 18077 tablet.cc:2369] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:58:59.691910 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.684946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.19.155.193:43953)
0811 18:58:59.685181 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.685187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.685210 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:58:59.685391 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.685397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.685519 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.685670 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:58:59.686104 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.687263 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.688739 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.689419 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.689563 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.690162 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:58:59.690958 (+ 796us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:58:59.691159 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.691571 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.691629 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:58:59.702087 17996 raft_consensus.cc:1261] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 1 FOLLOWER]: Refusing update from remote peer e047ea14c4d54b05b6c005b3f1bdb82b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:59.702087 18211 raft_consensus.cc:1261] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 1 FOLLOWER]: Refusing update from remote peer e047ea14c4d54b05b6c005b3f1bdb82b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:58:59.703228 18319 consensus_queue.cc:1035] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28850e511637418795b65a71b356ffb9" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:59.703583 18327 consensus_queue.cc:1035] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de005a8d350441cf80b4cd392d7389af" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 42683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:58:59.717125 18332 mvcc.cc:205] Tried to move back new op lower bound from 7317400533807747072 to 7317400533617254400. Current Snapshot: MvccSnapshot[applied={T|T < 7317400533807747072}]
I20260811 18:58:59.734117 17538 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:59.734445 17538 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:58:59.738260 17538 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c4772b72160946b599a531abe119ab37: Sending DeleteTablet for 3 replicas of tablet 973a9ac8df854285b2eaf05164119a8d
I20260811 18:58:59.739599 17742 tablet_service.cc:1514] Processing DeleteTablet for tablet 973a9ac8df854285b2eaf05164119a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:35818
I20260811 18:58:59.739655 18184 tablet_service.cc:1514] Processing DeleteTablet for tablet 973a9ac8df854285b2eaf05164119a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:59706
I20260811 18:58:59.739655 17967 tablet_service.cc:1514] Processing DeleteTablet for tablet 973a9ac8df854285b2eaf05164119a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:58:59 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:46808
I20260811 18:58:59.740846 18350 tablet_replica.cc:330] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: stopping tablet replica
I20260811 18:58:59.741475 18350 raft_consensus.cc:2229] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:59.742197 18350 raft_consensus.cc:2258] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:59.742609 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 17636
I20260811 18:58:59.743268 18352 tablet_replica.cc:330] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: stopping tablet replica
I20260811 18:58:59.743815 18352 raft_consensus.cc:2229] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:58:59.744441 18352 raft_consensus.cc:2258] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:59.745347 18349 tablet_replica.cc:330] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: stopping tablet replica
I20260811 18:58:59.745852 18349 raft_consensus.cc:2229] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:58:59.746551 18349 raft_consensus.cc:2258] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:58:59.749007 18352 ts_tablet_manager.cc:1905] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:59.749140 18349 ts_tablet_manager.cc:1905] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:59.750592 18350 ts_tablet_manager.cc:1905] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:58:59.759948 18349 ts_tablet_manager.cc:1918] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:59.760239 18349 log.cc:1196] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/973a9ac8df854285b2eaf05164119a8d
I20260811 18:58:59.760903 18349 ts_tablet_manager.cc:1939] T 973a9ac8df854285b2eaf05164119a8d P e047ea14c4d54b05b6c005b3f1bdb82b: Deleting consensus metadata
I20260811 18:58:59.763078 17515 catalog_manager.cc:4841] TS e047ea14c4d54b05b6c005b3f1bdb82b (127.19.155.193:43953): tablet 973a9ac8df854285b2eaf05164119a8d (table test-table [id=31042607cfd1427a9a370e8ebd913513]) successfully deleted
I20260811 18:58:59.763715 18352 ts_tablet_manager.cc:1918] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:59.764020 18352 log.cc:1196] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/973a9ac8df854285b2eaf05164119a8d
I20260811 18:58:59.764700 18352 ts_tablet_manager.cc:1939] T 973a9ac8df854285b2eaf05164119a8d P 28850e511637418795b65a71b356ffb9: Deleting consensus metadata
I20260811 18:58:59.766356 18350 ts_tablet_manager.cc:1918] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:58:59.766589 18350 log.cc:1196] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/973a9ac8df854285b2eaf05164119a8d
I20260811 18:58:59.767261 18350 ts_tablet_manager.cc:1939] T 973a9ac8df854285b2eaf05164119a8d P de005a8d350441cf80b4cd392d7389af: Deleting consensus metadata
I20260811 18:58:59.767267 17517 catalog_manager.cc:4841] TS 28850e511637418795b65a71b356ffb9 (127.19.155.194:37597): tablet 973a9ac8df854285b2eaf05164119a8d (table test-table [id=31042607cfd1427a9a370e8ebd913513]) successfully deleted
Aug 11 18:58:59 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:58:59.769411 17519 catalog_manager.cc:4841] TS de005a8d350441cf80b4cd392d7389af (127.19.155.195:42683): tablet 973a9ac8df854285b2eaf05164119a8d (table test-table [id=31042607cfd1427a9a370e8ebd913513]) successfully deleted
I20260811 18:58:59.776024 18308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.747172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.19.155.193:43953)
0811 18:58:59.747376 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.747386 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.755463 (+ 8077us) server_negotiation.cc:407] Connection header received
0811 18:58:59.755697 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.755702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.755801 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.755918 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:59.758009 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.759398 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.761612 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.762317 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.762431 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.769222 (+ 6791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:59.769237 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:59.769254 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:59.769301 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:59.772786 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.773808 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.773815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.773817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.773983 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.774420 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.774423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.774425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.774809 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:59.775135 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.775518 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.775723 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:58:59.776934 17844 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:58:59.879282 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 17636
I20260811 18:58:59.911576 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 17863
Aug 11 18:58:59 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:58:59.927500 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:58:59.912415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46820 (local address 127.19.155.194:37597)
0811 18:58:59.912600 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:58:59.912604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:58:59.912643 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:58:59.912817 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:58:59.912821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:58:59.912888 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:58:59.912987 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:58:59.914294 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.915113 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.916384 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:58:59.916748 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:58:59.916839 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:58:59.921390 (+ 4551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:58:59.921406 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:58:59.921425 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:58:59.921465 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:58:59.924737 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.925445 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.925453 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.925455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.925586 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:58:59.925913 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:58:59.925916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:58:59.925918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:58:59.926340 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:58:59.926587 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 18:58:59.926847 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 18:58:59.927223 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:58:59.928236 18062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:00.019543 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 17863
I20260811 18:59:00.049649 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 18082
Aug 11 18:59:00 dist-test-slave-1nl6 krb5kdc[17456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:59:00.067615 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:00.050483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59712 (local address 127.19.155.195:42683)
0811 18:59:00.050695 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:00.050701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:00.050724 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:00.050870 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:00.050874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:00.051012 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:00.051126 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:00.052593 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:00.053346 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:00.054714 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:00.055366 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:00.055514 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:00.060700 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:00.060720 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:00.060740 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:00.060791 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:00.063998 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:00.064840 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:00.064848 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:00.064851 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:00.065028 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:00.065491 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:00.065503 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:00.065506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:00.066090 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:00.066417 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:00.066788 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 18:59:00.067082 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:59:00.068434 18275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:00.167851 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 18082
I20260811 18:59:00.198272 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 17481
I20260811 18:59:00.199507 17589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:00.313961 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 17481
2026-08-11T18:59:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5128 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T18:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:00Z Disabled control of system clock
I20260811 18:59:00.421389 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34751
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:59:00.804467 18373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:00.804824 18373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:00.804909 18373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:00.812659 18373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:00.812803 18373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:00.812842 18373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:00.812896 18373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:00.812942 18373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:00.822691 18373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34751
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:00.824165 18373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:00.825977 18373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:00.838493 18380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:00.838585 18381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:00.838541 18384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:00.840026 18373 server_base.cc:1034] running on GCE node
I20260811 18:59:00.840957 18373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:00.842525 18373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:00.843767 18373 hybrid_clock.cc:648] HybridClock initialized: now 1786474740843714 us; error 47 us; skew 500 ppm
I20260811 18:59:00.844168 18373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:00.846755 18373 webserver.cc:460] Webserver started at http://127.19.155.254:46407/ using document root <none> and password file <none>
I20260811 18:59:00.847564 18373 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:00.847661 18373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:00.847958 18373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:00.851089 18373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "67f01c1cdba448dbb30159ed92eaa977"
format_stamp: "Formatted at 2026-08-11 18:59:00 on dist-test-slave-1nl6"
server_key: "87eae5f0b41abb7985b8c4863ec4058f"
server_key_iv: "869eae878cc82b46c4d5888420a1e2e0"
server_key_version: "encryptionkey@0"
I20260811 18:59:00.851943 18373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "67f01c1cdba448dbb30159ed92eaa977"
format_stamp: "Formatted at 2026-08-11 18:59:00 on dist-test-slave-1nl6"
server_key: "87eae5f0b41abb7985b8c4863ec4058f"
server_key_iv: "869eae878cc82b46c4d5888420a1e2e0"
server_key_version: "encryptionkey@0"
I20260811 18:59:00.857524 18373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 18:59:00.861244 18393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:00.862715 18373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:59:00.862965 18373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "67f01c1cdba448dbb30159ed92eaa977"
format_stamp: "Formatted at 2026-08-11 18:59:00 on dist-test-slave-1nl6"
server_key: "87eae5f0b41abb7985b8c4863ec4058f"
server_key_iv: "869eae878cc82b46c4d5888420a1e2e0"
server_key_version: "encryptionkey@0"
I20260811 18:59:00.863224 18373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:00.878516 18373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:00.879586 18373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:00.879930 18373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:00.900820 18373 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34751
I20260811 18:59:00.900844 18479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34751 every 8 connection(s)
I20260811 18:59:00.902421 18373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:00.906585 18481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:00.908349 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 18373
I20260811 18:59:00.908536 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:00.909053 20079 external_mini_cluster.cc:1428] Setting key adc0cfda9e309153af92eeac14ee2fa5
I20260811 18:59:00.922817 18481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: Bootstrap starting.
I20260811 18:59:00.926255 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:00.911218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.19.155.254:34751)
0811 18:59:00.912511 (+ 1293us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:00.912530 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:00.912592 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:59:00.914588 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:00.914628 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:00.915456 (+ 828us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:00.915957 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:00.916573 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:00.918644 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:00.920274 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:00.921481 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:00.921679 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:00.923012 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:00.923026 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:00.923049 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:00.923868 (+ 819us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:00.923983 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:00.924012 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:00.924141 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:00.924402 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 18:59:00.924788 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":394,"threads_started":1}
I20260811 18:59:00.927408 18481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:00.928583 18481 log.cc:824] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:00.931882 18481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: No bootstrap required, opened a new log
I20260811 18:59:00.939728 18481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } }
I20260811 18:59:00.940181 18481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:00.940295 18481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f01c1cdba448dbb30159ed92eaa977, State: Initialized, Role: FOLLOWER
I20260811 18:59:00.940989 18481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } }
I20260811 18:59:00.941311 18481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:00.941474 18481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:00.941679 18481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:00.944018 18481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } }
I20260811 18:59:00.944568 18481 leader_election.cc:302] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67f01c1cdba448dbb30159ed92eaa977; no voters:
I20260811 18:59:00.945216 18481 leader_election.cc:288] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:00.945396 18490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:00.946177 18490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [term 1 LEADER]: Becoming Leader. State: Replica: 67f01c1cdba448dbb30159ed92eaa977, State: Running, Role: LEADER
I20260811 18:59:00.946733 18490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } }
I20260811 18:59:00.947597 18481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:00.949700 18492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67f01c1cdba448dbb30159ed92eaa977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } } }
I20260811 18:59:00.949815 18495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67f01c1cdba448dbb30159ed92eaa977. Latest consensus state: current_term: 1 leader_uuid: "67f01c1cdba448dbb30159ed92eaa977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67f01c1cdba448dbb30159ed92eaa977" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34751 } } }
I20260811 18:59:00.950278 18492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:00.950282 18495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:00.951264 18500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:00.957531 18500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:00.967725 18500 catalog_manager.cc:1347] Generated new cluster ID: e1cfff05a1d04245a25e351b973754a9
I20260811 18:59:00.967895 18500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:00.996181 18500 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:00.997810 18500 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:01.005877 18500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: Generated new TSK 0
I20260811 18:59:01.006861 18500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:01.015368 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--builtin_ntp_servers=127.19.155.212:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:59:01.393558 18523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:01.393896 18523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:01.393993 18523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:01.401579 18523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:01.401705 18523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:01.401816 18523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:59:01.411321 18523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:01.412851 18523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:01.414788 18523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:01.429255 18533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:01.429354 18532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:01.429388 18540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:01.429960 18523 server_base.cc:1034] running on GCE node
I20260811 18:59:01.430693 18523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:01.431768 18523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:01.432992 18523 hybrid_clock.cc:648] HybridClock initialized: now 1786474741432931 us; error 57 us; skew 500 ppm
I20260811 18:59:01.433317 18523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:01.435817 18523 webserver.cc:460] Webserver started at http://127.19.155.193:39853/ using document root <none> and password file <none>
I20260811 18:59:01.436545 18523 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:01.436640 18523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:01.436924 18523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:01.440143 18523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "d88dcd73ae634133ae4d96ac9feca2c4"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "0abd386a8d90fb2b5989432e7e50e04d"
server_key_iv: "91f54b2a72030137fe36e8def8d55c4a"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.440982 18523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "d88dcd73ae634133ae4d96ac9feca2c4"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "0abd386a8d90fb2b5989432e7e50e04d"
server_key_iv: "91f54b2a72030137fe36e8def8d55c4a"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.446668 18523 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 18:59:01.450872 18549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:01.452448 18523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:59:01.452605 18523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "d88dcd73ae634133ae4d96ac9feca2c4"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "0abd386a8d90fb2b5989432e7e50e04d"
server_key_iv: "91f54b2a72030137fe36e8def8d55c4a"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.452812 18523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:01.470093 18523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:01.471036 18523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:01.471331 18523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:01.472357 18523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:01.473879 18523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:01.473974 18523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:01.474058 18523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:01.474116 18523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:01.509523 18523 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:34877
I20260811 18:59:01.509581 18735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:34877 every 8 connection(s)
I20260811 18:59:01.511039 18523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:59:01.513954 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 18523
I20260811 18:59:01.514140 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:59:01.514717 20079 external_mini_cluster.cc:1428] Setting key 20971240a7bad10173a36904547aca67
I20260811 18:59:01.517940 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--builtin_ntp_servers=127.19.155.212:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:59:01.525207 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:01.513762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54009 (local address 127.19.155.254:34751)
0811 18:59:01.514245 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:01.514250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:01.515884 (+ 1634us) server_negotiation.cc:407] Connection header received
0811 18:59:01.518255 (+ 2371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:01.518266 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:01.518338 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:01.518466 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:01.519732 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:01.520476 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:01.522117 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:01.522556 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:01.522713 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:01.524284 (+ 1571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:01.524291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:01.524296 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:01.524325 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:01.524370 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:01.524383 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:01.524484 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:01.524730 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 18:59:01.524847 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":264,"threads_started":1}
I20260811 18:59:01.526309 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:01.514551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34751 (local address 127.19.155.193:54009)
0811 18:59:01.515735 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:01.515774 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:01.517841 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:01.518738 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:01.518747 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:01.518847 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:01.519547 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:01.519566 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:01.520657 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:01.520661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:01.521957 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:01.521970 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:01.522825 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:01.522833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:01.523156 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:01.523934 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:01.523937 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:01.523982 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:01.524070 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:01.524485 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:01.524499 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:01.524510 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 18:59:01.524700 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 18:59:01.525145 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":377,"threads_started":1}
I20260811 18:59:01.528111 18736 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34751
I20260811 18:59:01.528452 18736 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:01.529309 18736 heartbeater.cc:511] Master 127.19.155.254:34751 requested a full tablet report, sending...
I20260811 18:59:01.531831 18428 ts_manager.cc:194] Registered new tserver with Master: d88dcd73ae634133ae4d96ac9feca2c4 (127.19.155.193:34877)
I20260811 18:59:01.533437 18428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.193:54009
W20260811 18:59:01.885090 18744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:01.885430 18744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:01.885581 18744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:01.893206 18744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:01.893334 18744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:01.893509 18744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:59:01.903378 18744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:01.904729 18744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:01.906574 18744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:01.920872 18756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:01.920974 18755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:01.920869 18758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:01.921833 18744 server_base.cc:1034] running on GCE node
I20260811 18:59:01.922585 18744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:01.923808 18744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:01.925064 18744 hybrid_clock.cc:648] HybridClock initialized: now 1786474741925009 us; error 67 us; skew 500 ppm
I20260811 18:59:01.925455 18744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:01.928066 18744 webserver.cc:460] Webserver started at http://127.19.155.194:37141/ using document root <none> and password file <none>
I20260811 18:59:01.928844 18744 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:01.928988 18744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:01.929337 18744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:01.932494 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "ee448820bd5546208885169c9a92c8c3"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "3ae136e35e890a1492232f957e1328cf"
server_key_iv: "0e0202f958fdfa08748db5a599b26348"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.933383 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "ee448820bd5546208885169c9a92c8c3"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "3ae136e35e890a1492232f957e1328cf"
server_key_iv: "0e0202f958fdfa08748db5a599b26348"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.939260 18744 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:59:01.943171 18771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:01.944659 18744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:01.944882 18744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "ee448820bd5546208885169c9a92c8c3"
format_stamp: "Formatted at 2026-08-11 18:59:01 on dist-test-slave-1nl6"
server_key: "3ae136e35e890a1492232f957e1328cf"
server_key_iv: "0e0202f958fdfa08748db5a599b26348"
server_key_version: "encryptionkey@0"
I20260811 18:59:01.945132 18744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:01.968369 18744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:01.969331 18744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:01.969679 18744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:01.970819 18744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:01.972510 18744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:01.972646 18744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:01.972792 18744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:01.972889 18744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:02.009617 18744 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:33495
I20260811 18:59:02.009706 18953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:33495 every 8 connection(s)
I20260811 18:59:02.011169 18744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:59:02.015910 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 18744
I20260811 18:59:02.016111 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:59:02.016613 20079 external_mini_cluster.cc:1428] Setting key 10cb1cc974a3203eb80905bf543902e5
I20260811 18:59:02.019999 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--builtin_ntp_servers=127.19.155.212:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:59:02.027241 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.014117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:42599 (local address 127.19.155.254:34751)
0811 18:59:02.014337 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.014342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.015959 (+ 1617us) server_negotiation.cc:407] Connection header received
0811 18:59:02.018218 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.018224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.018317 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.018447 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:02.020179 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.020988 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.023767 (+ 2779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.024184 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.024308 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.026207 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:02.026213 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:02.026217 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:02.026240 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:02.026277 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:02.026290 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:02.026362 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.026670 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.026807 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:59:02.028790 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.014697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34751 (local address 127.19.155.194:42599)
0811 18:59:02.015767 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.015809 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.017889 (+ 2080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.018759 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.018772 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.018943 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:02.019890 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.019922 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.021194 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.021203 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.023540 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.023561 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.024458 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.024468 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.024855 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.025739 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:02.025745 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:02.025813 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:02.025945 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:02.026397 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:02.026412 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:02.026424 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.026636 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.027187 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":373,"threads_started":1}
I20260811 18:59:02.030506 18954 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34751
I20260811 18:59:02.030937 18954 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:02.031823 18954 heartbeater.cc:511] Master 127.19.155.254:34751 requested a full tablet report, sending...
I20260811 18:59:02.033556 18428 ts_manager.cc:194] Registered new tserver with Master: ee448820bd5546208885169c9a92c8c3 (127.19.155.194:33495)
I20260811 18:59:02.034526 18428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.194:42599
W20260811 18:59:02.404456 18959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:02.404788 18959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:02.404877 18959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:02.412487 18959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:02.412619 18959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:02.412730 18959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:59:02.422140 18959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:34751
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:02.423521 18959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:02.425598 18959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:02.440065 18968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:02.440161 18969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:02.440179 18972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:02.441354 18959 server_base.cc:1034] running on GCE node
I20260811 18:59:02.442070 18959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:02.443395 18959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:02.444621 18959 hybrid_clock.cc:648] HybridClock initialized: now 1786474742444562 us; error 46 us; skew 500 ppm
I20260811 18:59:02.444952 18959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:02.447635 18959 webserver.cc:460] Webserver started at http://127.19.155.195:43939/ using document root <none> and password file <none>
I20260811 18:59:02.448468 18959 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:02.448568 18959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:02.448954 18959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:02.452250 18959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "38e05cdc709f424bbf7cd72706242d03"
format_stamp: "Formatted at 2026-08-11 18:59:02 on dist-test-slave-1nl6"
server_key: "e0aac7d2028565a9ebd28a694aa46376"
server_key_iv: "2477ae9815b140981421de9d47129563"
server_key_version: "encryptionkey@0"
I20260811 18:59:02.453136 18959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "38e05cdc709f424bbf7cd72706242d03"
format_stamp: "Formatted at 2026-08-11 18:59:02 on dist-test-slave-1nl6"
server_key: "e0aac7d2028565a9ebd28a694aa46376"
server_key_iv: "2477ae9815b140981421de9d47129563"
server_key_version: "encryptionkey@0"
I20260811 18:59:02.459785 18959 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 18:59:02.465914 18983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:02.467708 18959 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:59:02.467940 18959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "38e05cdc709f424bbf7cd72706242d03"
format_stamp: "Formatted at 2026-08-11 18:59:02 on dist-test-slave-1nl6"
server_key: "e0aac7d2028565a9ebd28a694aa46376"
server_key_iv: "2477ae9815b140981421de9d47129563"
server_key_version: "encryptionkey@0"
I20260811 18:59:02.468201 18959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:02.493009 18959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:02.493975 18959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:02.494338 18959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:02.495503 18959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:02.497236 18959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:02.497380 18959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:02.497521 18959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:02.497615 18959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:02.536449 18959 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:46055
I20260811 18:59:02.536550 19197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:46055 every 8 connection(s)
I20260811 18:59:02.536913 18736 heartbeater.cc:503] Master 127.19.155.254:34751 was elected leader, sending a full tablet report...
I20260811 18:59:02.538132 18959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:59:02.548408 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 18959
I20260811 18:59:02.548592 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:59:02.549233 20079 external_mini_cluster.cc:1428] Setting key ca80edf828af4f83c1f8a043608e495c
I20260811 18:59:02.552410 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.541019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:41075 (local address 127.19.155.254:34751)
0811 18:59:02.541446 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.541451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.542799 (+ 1348us) server_negotiation.cc:407] Connection header received
0811 18:59:02.544694 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.544699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.544772 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.544874 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:02.546044 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.546840 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.548804 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.549477 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.549622 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.551471 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:02.551478 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:02.551484 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:02.551508 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:02.551561 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:02.551580 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:02.551686 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.551998 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.552098 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":226,"threads_started":1}
I20260811 18:59:02.553858 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.541685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:34751 (local address 127.19.155.195:41075)
0811 18:59:02.542619 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.542663 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.544411 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.545102 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.545110 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.545217 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:02.545853 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.545873 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.547068 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.547072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.548553 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.548574 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.549760 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.549770 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.550112 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.551038 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:02.551041 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:02.551087 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:02.551244 (+ 157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:02.551714 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:02.551729 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:02.551738 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.551964 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.552487 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":268,"threads_started":1}
I20260811 18:59:02.555437 19199 heartbeater.cc:347] Connected to a master server at 127.19.155.254:34751
I20260811 18:59:02.555794 19199 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:02.556658 19199 heartbeater.cc:511] Master 127.19.155.254:34751 requested a full tablet report, sending...
I20260811 18:59:02.558411 18428 ts_manager.cc:194] Registered new tserver with Master: 38e05cdc709f424bbf7cd72706242d03 (127.19.155.195:46055)
I20260811 18:59:02.559343 18428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.195:41075
I20260811 18:59:02.565915 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:59:02.577251 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.570862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.19.155.254:34751)
0811 18:59:02.571083 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.571088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.571561 (+ 473us) server_negotiation.cc:407] Connection header received
0811 18:59:02.571710 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.571714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.571785 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.571886 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:02.572431 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.573254 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.574675 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.575234 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.575344 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.576471 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:02.576476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:02.576480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:02.576501 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:02.576538 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:02.576550 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:02.576765 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.576952 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.577007 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 18:59:02.581903 18428 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:59:02.589202 18428 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:59:02.615262 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.603472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56082 (local address 127.19.155.193:34877)
0811 18:59:02.605295 (+ 1823us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.605306 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.605902 (+ 596us) server_negotiation.cc:407] Connection header received
0811 18:59:02.606192 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.606200 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.606427 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.606608 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:02.607631 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.609193 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.612500 (+ 3307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.613563 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.613803 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.614079 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.614577 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.614810 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1634,"thread_start_us":1495,"threads_started":1}
I20260811 18:59:02.615635 19216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.602749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33495 (local address 127.0.0.1:39548)
0811 18:59:02.604316 (+ 1567us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.604382 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.604625 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.606389 (+ 1764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.606398 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.606437 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:02.607050 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.607071 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.609379 (+ 2308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.609388 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.612293 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.612309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.614384 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.614390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.614588 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.614974 (+ 386us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.615066 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.615234 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1178,"mutex_wait_us":441,"thread_start_us":981,"threads_started":1}
I20260811 18:59:02.616523 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.603502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39548 (local address 127.19.155.194:33495)
0811 18:59:02.605659 (+ 2157us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.605667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.605702 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:59:02.605842 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.605853 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.606142 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.606958 (+ 816us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:02.607516 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.609188 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.612571 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.614143 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.614333 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.614559 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.615977 (+ 1418us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.616169 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1955,"thread_start_us":1830,"threads_started":1}
I20260811 18:59:02.617671 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.602886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56082)
0811 18:59:02.605785 (+ 2899us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.605804 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.606007 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.606966 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.606971 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.606998 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:02.607426 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.607442 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.609424 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.609432 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.612278 (+ 2846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.612291 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.613802 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.613808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.614069 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.614139 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.614304 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.616449 (+ 2145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2770,"mutex_wait_us":446,"thread_start_us":2558,"threads_started":1}
I20260811 18:59:02.619496 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.606799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:46055 (local address 127.0.0.1:59084)
0811 18:59:02.609872 (+ 3073us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.609894 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.610041 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.611186 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.611191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.611218 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:02.611761 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.611782 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.613973 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.613979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.616657 (+ 2678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.616675 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.618682 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.618690 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.618891 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.618952 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.619046 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.619179 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2917,"mutex_wait_us":41,"thread_start_us":2730,"threads_started":1}
I20260811 18:59:02.619963 19223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.606335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.19.155.195:46055)
0811 18:59:02.607625 (+ 1290us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.607634 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.610186 (+ 2552us) server_negotiation.cc:407] Connection header received
0811 18:59:02.610319 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.610329 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.610585 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.610808 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:02.612017 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.613763 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.616904 (+ 3141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.618101 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.618304 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.618538 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.619163 (+ 625us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.619356 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1052,"thread_start_us":876,"threads_started":1}
I20260811 18:59:02.620939 18849 tablet_service.cc:1467] Processing CreateTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 (DEFAULT_TABLE table=test-table [id=825aeb9e59914c0e8ad6585e4b028582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:02.621449 18616 tablet_service.cc:1467] Processing CreateTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 (DEFAULT_TABLE table=test-table [id=825aeb9e59914c0e8ad6585e4b028582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:02.622449 18849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4774f6c76aec4cc49040df2bb66f4684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:02.622794 18616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4774f6c76aec4cc49040df2bb66f4684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:02.627571 19077 tablet_service.cc:1467] Processing CreateTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 (DEFAULT_TABLE table=test-table [id=825aeb9e59914c0e8ad6585e4b028582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:02.629390 19077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4774f6c76aec4cc49040df2bb66f4684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:02.637866 19227 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Bootstrap starting.
I20260811 18:59:02.641407 19227 tablet_bootstrap.cc:654] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:02.642489 19229 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Bootstrap starting.
I20260811 18:59:02.642922 19227 log.cc:824] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:02.646520 19227 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: No bootstrap required, opened a new log
I20260811 18:59:02.646693 19231 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Bootstrap starting.
I20260811 18:59:02.646848 19227 ts_tablet_manager.cc:1397] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 18:59:02.646782 19229 tablet_bootstrap.cc:654] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:02.648600 19229 log.cc:824] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:02.650935 19231 tablet_bootstrap.cc:654] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:02.652391 19231 log.cc:824] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:02.652536 19229 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: No bootstrap required, opened a new log
I20260811 18:59:02.652851 19229 ts_tablet_manager.cc:1397] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260811 18:59:02.656193 19231 tablet_bootstrap.cc:492] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: No bootstrap required, opened a new log
I20260811 18:59:02.656513 19231 ts_tablet_manager.cc:1397] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260811 18:59:02.657001 19227 raft_consensus.cc:348] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.657681 19227 raft_consensus.cc:374] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:02.657804 19227 raft_consensus.cc:729] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee448820bd5546208885169c9a92c8c3, State: Initialized, Role: FOLLOWER
I20260811 18:59:02.658531 19227 consensus_queue.cc:260] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.659835 18954 heartbeater.cc:503] Master 127.19.155.254:34751 was elected leader, sending a full tablet report...
I20260811 18:59:02.660422 19227 ts_tablet_manager.cc:1428] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260811 18:59:02.663210 19229 raft_consensus.cc:348] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.663652 19229 raft_consensus.cc:374] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:02.663779 19229 raft_consensus.cc:729] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88dcd73ae634133ae4d96ac9feca2c4, State: Initialized, Role: FOLLOWER
I20260811 18:59:02.664462 19229 consensus_queue.cc:260] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.666442 19229 ts_tablet_manager.cc:1428] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260811 18:59:02.668818 19231 raft_consensus.cc:348] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.669353 19231 raft_consensus.cc:374] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:02.669493 19231 raft_consensus.cc:729] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e05cdc709f424bbf7cd72706242d03, State: Initialized, Role: FOLLOWER
I20260811 18:59:02.670236 19231 consensus_queue.cc:260] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.671530 19199 heartbeater.cc:503] Master 127.19.155.254:34751 was elected leader, sending a full tablet report...
I20260811 18:59:02.672429 19231 ts_tablet_manager.cc:1428] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260811 18:59:02.707697 19244 raft_consensus.cc:482] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:59:02.708076 19244 raft_consensus.cc:504] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.709990 19244 leader_election.cc:288] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee448820bd5546208885169c9a92c8c3 (127.19.155.194:33495), d88dcd73ae634133ae4d96ac9feca2c4 (127.19.155.193:34877)
I20260811 18:59:02.716928 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.710366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:52095 (local address 127.19.155.194:33495)
0811 18:59:02.710581 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.710587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.710704 (+ 117us) server_negotiation.cc:407] Connection header received
0811 18:59:02.710984 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.710993 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.711069 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.711184 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:02.711716 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.712795 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.714790 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.716033 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.716157 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.716215 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.716596 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.716716 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 18:59:02.717010 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.710207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33495 (local address 127.19.155.195:52095)
0811 18:59:02.710590 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.710612 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.710772 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.711275 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.711281 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.711327 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:02.711497 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.711505 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.712927 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.712933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.714597 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.714610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.716189 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.716195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.716379 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.716422 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.716528 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.716692 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233}
I20260811 18:59:02.718387 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.710597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.19.155.195:57175)
0811 18:59:02.711493 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:02.711508 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:02.711644 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:02.711989 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:02.711994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:02.712020 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:02.712454 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.712467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.713805 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.713809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.715609 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:02.715626 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.717731 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.717740 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:02.717896 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.717940 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 18:59:02.718024 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 18:59:02.718123 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"mutex_wait_us":4,"thread_start_us":489,"threads_started":1}
I20260811 18:59:02.718518 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.710703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:57175 (local address 127.19.155.193:34877)
0811 18:59:02.710938 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.710943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.711606 (+ 663us) server_negotiation.cc:407] Connection header received
0811 18:59:02.711777 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.711781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.711856 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.711927 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:02.712637 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.713606 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.716135 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.717427 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.717760 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.717846 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.718090 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.718261 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:59:02.718367 18878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4774f6c76aec4cc49040df2bb66f4684" candidate_uuid: "38e05cdc709f424bbf7cd72706242d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee448820bd5546208885169c9a92c8c3" is_pre_election: true
I20260811 18:59:02.719079 18878 raft_consensus.cc:2454] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38e05cdc709f424bbf7cd72706242d03 in term 0.
I20260811 18:59:02.719524 18654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4774f6c76aec4cc49040df2bb66f4684" candidate_uuid: "38e05cdc709f424bbf7cd72706242d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" is_pre_election: true
I20260811 18:59:02.719909 18990 leader_election.cc:302] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38e05cdc709f424bbf7cd72706242d03, ee448820bd5546208885169c9a92c8c3; no voters:
I20260811 18:59:02.720067 18654 raft_consensus.cc:2454] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38e05cdc709f424bbf7cd72706242d03 in term 0.
I20260811 18:59:02.720337 19244 raft_consensus.cc:2781] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:59:02.720486 19244 raft_consensus.cc:482] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:59:02.720604 19244 raft_consensus.cc:3037] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:02.723037 19244 raft_consensus.cc:504] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.723694 19244 leader_election.cc:288] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [CANDIDATE]: Term 1 election: Requested vote from peers ee448820bd5546208885169c9a92c8c3 (127.19.155.194:33495), d88dcd73ae634133ae4d96ac9feca2c4 (127.19.155.193:34877)
I20260811 18:59:02.724212 18878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4774f6c76aec4cc49040df2bb66f4684" candidate_uuid: "38e05cdc709f424bbf7cd72706242d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee448820bd5546208885169c9a92c8c3"
I20260811 18:59:02.724359 18654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4774f6c76aec4cc49040df2bb66f4684" candidate_uuid: "38e05cdc709f424bbf7cd72706242d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d88dcd73ae634133ae4d96ac9feca2c4"
I20260811 18:59:02.724469 18878 raft_consensus.cc:3037] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:02.724591 18654 raft_consensus.cc:3037] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:02.728011 18878 raft_consensus.cc:2454] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e05cdc709f424bbf7cd72706242d03 in term 1.
I20260811 18:59:02.728011 18654 raft_consensus.cc:2454] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e05cdc709f424bbf7cd72706242d03 in term 1.
I20260811 18:59:02.728616 18988 leader_election.cc:302] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38e05cdc709f424bbf7cd72706242d03, d88dcd73ae634133ae4d96ac9feca2c4; no voters:
I20260811 18:59:02.729046 19244 raft_consensus.cc:2781] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:02.729540 19244 raft_consensus.cc:686] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 1 LEADER]: Becoming Leader. State: Replica: 38e05cdc709f424bbf7cd72706242d03, State: Running, Role: LEADER
I20260811 18:59:02.730155 19244 consensus_queue.cc:237] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } }
I20260811 18:59:02.735567 18428 catalog_manager.cc:5495] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38e05cdc709f424bbf7cd72706242d03 (127.19.155.195). New cstate: current_term: 1 leader_uuid: "38e05cdc709f424bbf7cd72706242d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38e05cdc709f424bbf7cd72706242d03" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 46055 } health_report { overall_health: HEALTHY } } }
W20260811 18:59:02.763512 18956 tablet.cc:2369] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:59:02.763546 18738 tablet.cc:2369] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:02.774513 19223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.768878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59088 (local address 127.19.155.195:46055)
0811 18:59:02.769106 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.769111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.769130 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:59:02.769313 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.769317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.769415 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.769546 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:02.769927 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.770640 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.772235 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.772686 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.772784 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.773354 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:02.773871 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:02.774000 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.774150 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.774220 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 18:59:02.783437 18654 raft_consensus.cc:1261] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 1 FOLLOWER]: Refusing update from remote peer 38e05cdc709f424bbf7cd72706242d03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:02.783499 18878 raft_consensus.cc:1261] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 1 FOLLOWER]: Refusing update from remote peer 38e05cdc709f424bbf7cd72706242d03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:02.784516 19247 consensus_queue.cc:1035] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d88dcd73ae634133ae4d96ac9feca2c4" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 34877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:02.784940 19244 consensus_queue.cc:1035] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee448820bd5546208885169c9a92c8c3" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:59:02.790107 19200 tablet.cc:2369] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:02.795509 19254 mvcc.cc:205] Tried to move back new op lower bound from 7317400546429468672 to 7317400546227560448. Current Snapshot: MvccSnapshot[applied={T|T < 7317400546429468672}]
I20260811 18:59:02.797437 19255 mvcc.cc:205] Tried to move back new op lower bound from 7317400546429468672 to 7317400546227560448. Current Snapshot: MvccSnapshot[applied={T|T < 7317400546429468672}]
I20260811 18:59:02.814249 18428 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:02.814548 18428 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:02.818661 18428 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67f01c1cdba448dbb30159ed92eaa977: Sending DeleteTablet for 3 replicas of tablet 4774f6c76aec4cc49040df2bb66f4684
I20260811 18:59:02.820226 18849 tablet_service.cc:1514] Processing DeleteTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:02 UTC) from {username='slave'} at 127.0.0.1:39548
I20260811 18:59:02.820250 18616 tablet_service.cc:1514] Processing DeleteTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:02 UTC) from {username='slave'} at 127.0.0.1:56082
I20260811 18:59:02.820309 19077 tablet_service.cc:1514] Processing DeleteTablet for tablet 4774f6c76aec4cc49040df2bb66f4684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:02 UTC) from {username='slave'} at 127.0.0.1:59084
I20260811 18:59:02.822691 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 18523
I20260811 18:59:02.829985 19268 tablet_replica.cc:330] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: stopping tablet replica
I20260811 18:59:02.830695 19268 raft_consensus.cc:2229] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:59:02.831559 19268 raft_consensus.cc:2258] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:02.832706 19267 tablet_replica.cc:330] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: stopping tablet replica
I20260811 18:59:02.833377 19265 tablet_replica.cc:330] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: stopping tablet replica
I20260811 18:59:02.833956 19267 raft_consensus.cc:2229] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:02.834532 19265 raft_consensus.cc:2229] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:02.834769 19268 ts_tablet_manager.cc:1905] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:02.835403 19267 raft_consensus.cc:2258] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:02.835842 19265 raft_consensus.cc:2258] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:02.839681 19267 ts_tablet_manager.cc:1905] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:02.842765 19265 ts_tablet_manager.cc:1905] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:02.843320 19268 ts_tablet_manager.cc:1918] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:02.843535 19268 log.cc:1196] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/4774f6c76aec4cc49040df2bb66f4684
I20260811 18:59:02.844128 19268 ts_tablet_manager.cc:1939] T 4774f6c76aec4cc49040df2bb66f4684 P 38e05cdc709f424bbf7cd72706242d03: Deleting consensus metadata
I20260811 18:59:02.846187 18396 catalog_manager.cc:4841] TS 38e05cdc709f424bbf7cd72706242d03 (127.19.155.195:46055): tablet 4774f6c76aec4cc49040df2bb66f4684 (table test-table [id=825aeb9e59914c0e8ad6585e4b028582]) successfully deleted
I20260811 18:59:02.847424 19267 ts_tablet_manager.cc:1918] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:02.847621 19267 log.cc:1196] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/4774f6c76aec4cc49040df2bb66f4684
I20260811 18:59:02.848290 19267 ts_tablet_manager.cc:1939] T 4774f6c76aec4cc49040df2bb66f4684 P ee448820bd5546208885169c9a92c8c3: Deleting consensus metadata
I20260811 18:59:02.849375 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:02.826216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56090 (local address 127.19.155.193:34877)
0811 18:59:02.826484 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:02.826493 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:02.833698 (+ 7205us) server_negotiation.cc:407] Connection header received
0811 18:59:02.834065 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:02.834074 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:02.834225 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:02.834313 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:02.835489 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.837484 (+ 1995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.839565 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:02.840228 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:02.840345 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:02.847272 (+ 6927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:02.847299 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:02.847319 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:02.848217 (+ 898us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:02.848286 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:02.848336 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:02.848467 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:02.848802 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 18:59:02.848945 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 18:59:02.850355 19265 ts_tablet_manager.cc:1918] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:02.850443 18405 catalog_manager.cc:4841] TS ee448820bd5546208885169c9a92c8c3 (127.19.155.194:33495): tablet 4774f6c76aec4cc49040df2bb66f4684 (table test-table [id=825aeb9e59914c0e8ad6585e4b028582]) successfully deleted
I20260811 18:59:02.850541 19265 log.cc:1196] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/4774f6c76aec4cc49040df2bb66f4684
I20260811 18:59:02.850872 18725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:02.987550 19265 ts_tablet_manager.cc:1939] T 4774f6c76aec4cc49040df2bb66f4684 P d88dcd73ae634133ae4d96ac9feca2c4: Deleting consensus metadata
I20260811 18:59:02.988286 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 18523
W20260811 18:59:03.028986 18396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.155.193:34877 (error 108)
I20260811 18:59:03.029330 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 18744
I20260811 18:59:03.031489 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.030945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56094)
0811 18:59:03.031143 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.031296 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 18:59:03.031881 18396 catalog_manager.cc:4584] TS d88dcd73ae634133ae4d96ac9feca2c4 (127.19.155.193:34877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4774f6c76aec4cc49040df2bb66f4684: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
I20260811 18:59:03.038568 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.031010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39556 (local address 127.19.155.194:33495)
0811 18:59:03.031190 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:03.031195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:03.031218 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:03.031291 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:03.031296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:03.031421 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:03.031561 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:03.032104 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:03.032958 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:03.034982 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:03.035569 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:03.035676 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:03.036986 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:03.036997 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:03.037014 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:03.037663 (+ 649us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:03.037724 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:03.037746 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:03.037923 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:03.038079 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 18:59:03.038209 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 18:59:03.039434 18947 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:03.086019 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.085403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56108)
0811 18:59:03.085677 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.085793 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 18:59:03.087352 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.086893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56118)
0811 18:59:03.087078 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.087179 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 18:59:03.132432 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 18744
I20260811 18:59:03.147996 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.147526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56134)
0811 18:59:03.147746 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.147834 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 18:59:03.149226 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.148843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56144)
0811 18:59:03.149008 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.149104 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:59:03.173785 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 18959
I20260811 18:59:03.182479 19223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.174679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.19.155.195:46055)
0811 18:59:03.174884 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:03.174890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:03.174937 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:59:03.175193 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:03.175199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:03.175319 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:03.175445 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:03.175847 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:03.176996 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:03.178375 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:03.179072 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:03.179246 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:03.180534 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:03.180547 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:03.180568 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:03.181467 (+ 899us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:03.181538 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:03.181566 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:03.181714 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:03.181918 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:59:03.182047 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 18:59:03.183413 19186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:03.230274 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.229622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56154)
0811 18:59:03.229917 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.230042 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 18:59:03.231673 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.231164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56168)
0811 18:59:03.231418 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.231525 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 18:59:03.309147 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 18959
I20260811 18:59:03.338325 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 18373
I20260811 18:59:03.339594 18474 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:03.450721 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:03.450048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:34877 (local address 127.0.0.1:56170)
0811 18:59:03.450431 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:03.450536 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:34877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218}
I20260811 18:59:03.450979 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 18373
2026-08-11T18:59:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3134 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:03 dist-test-slave-1nl6 krb5kdc[19285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:03 dist-test-slave-1nl6 krb5kdc[19285](info): set up 2 sockets
Aug 11 18:59:03 dist-test-slave-1nl6 krb5kdc[19285](info): commencing operation
krb5kdc: starting...
W20260811 18:59:04.854439 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.351s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:05 dist-test-slave-1nl6 krb5kdc[19285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:05.204315 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38649
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:05.577931 19311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:05.578270 19311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:05.578459 19311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:05.585984 19311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:05.586128 19311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:05.586231 19311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:05.586340 19311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:05.586438 19311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:05.596827 19311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:05.598335 19311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:05.599874 19311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:05.612672 19324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:05.612622 19320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:05.612605 19322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:05.613586 19311 server_base.cc:1034] running on GCE node
I20260811 18:59:05.614539 19311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:05.616139 19311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:05.617372 19311 hybrid_clock.cc:648] HybridClock initialized: now 1786474745617317 us; error 44 us; skew 500 ppm
I20260811 18:59:05.617784 19311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:05 dist-test-slave-1nl6 krb5kdc[19285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:05.628006 19311 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:05.629945 19311 webserver.cc:460] Webserver started at http://127.19.155.254:42509/ using document root <none> and password file <none>
I20260811 18:59:05.630757 19311 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:05.630993 19311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:05.631354 19311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:05.634821 19311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "deb6828c164f4f60b85479448e800a32"
format_stamp: "Formatted at 2026-08-11 18:59:05 on dist-test-slave-1nl6"
server_key: "21509c2b8faa68300f56cd4e45df655d"
server_key_iv: "02f042ea636ce3a2840de07c269caf07"
server_key_version: "encryptionkey@0"
I20260811 18:59:05.635819 19311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "deb6828c164f4f60b85479448e800a32"
format_stamp: "Formatted at 2026-08-11 18:59:05 on dist-test-slave-1nl6"
server_key: "21509c2b8faa68300f56cd4e45df655d"
server_key_iv: "02f042ea636ce3a2840de07c269caf07"
server_key_version: "encryptionkey@0"
I20260811 18:59:05.641848 19311 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:59:05.646219 19333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:05.648021 19311 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 18:59:05.648289 19311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "deb6828c164f4f60b85479448e800a32"
format_stamp: "Formatted at 2026-08-11 18:59:05 on dist-test-slave-1nl6"
server_key: "21509c2b8faa68300f56cd4e45df655d"
server_key_iv: "02f042ea636ce3a2840de07c269caf07"
server_key_version: "encryptionkey@0"
I20260811 18:59:05.648545 19311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:05.667405 19311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:05.672309 19311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:05.672652 19311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:05.693850 19311 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:38649
I20260811 18:59:05.693892 19421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:38649 every 8 connection(s)
I20260811 18:59:05.695434 19311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:05.699561 19428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:05.700623 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 19311
I20260811 18:59:05.700841 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:05.701465 20079 external_mini_cluster.cc:1428] Setting key 0b7ab601a580421a257ce7646ff54f77
I20260811 18:59:05.715624 19428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: Bootstrap starting.
Aug 11 18:59:05 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:05.719844 19428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:05.721422 19428 log.cc:824] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:05.725273 19428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: No bootstrap required, opened a new log
I20260811 18:59:05.727595 19432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:05.703594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.19.155.254:38649)
0811 18:59:05.704526 (+ 932us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:05.704539 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:05.704583 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:59:05.706482 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:05.706513 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:05.707043 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:05.707511 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:05.709557 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:05.711003 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:05.712973 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:05.713736 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:05.713892 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:05.719220 (+ 5328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:05.719229 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:05.719248 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:05.719297 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:05.722753 (+ 3456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:05.723840 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:05.723848 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:05.723856 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:05.724051 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:05.724560 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:05.724563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:05.724565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:05.725131 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:05.725443 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:05.725936 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 18:59:05.726378 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":419,"threads_started":1}
I20260811 18:59:05.734777 19428 raft_consensus.cc:348] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } }
I20260811 18:59:05.735270 19428 raft_consensus.cc:374] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:05.735416 19428 raft_consensus.cc:729] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb6828c164f4f60b85479448e800a32, State: Initialized, Role: FOLLOWER
I20260811 18:59:05.735997 19428 consensus_queue.cc:260] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } }
I20260811 18:59:05.736248 19428 raft_consensus.cc:388] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:05.736398 19428 raft_consensus.cc:482] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:05.736583 19428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:05.739051 19428 raft_consensus.cc:504] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } }
I20260811 18:59:05.739728 19428 leader_election.cc:302] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deb6828c164f4f60b85479448e800a32; no voters:
I20260811 18:59:05.740425 19428 leader_election.cc:288] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:05.740581 19435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:05.741345 19435 raft_consensus.cc:686] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [term 1 LEADER]: Becoming Leader. State: Replica: deb6828c164f4f60b85479448e800a32, State: Running, Role: LEADER
I20260811 18:59:05.741940 19435 consensus_queue.cc:237] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } }
I20260811 18:59:05.742697 19428 sys_catalog.cc:564] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:05.744907 19439 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb6828c164f4f60b85479448e800a32. Latest consensus state: current_term: 1 leader_uuid: "deb6828c164f4f60b85479448e800a32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } } }
I20260811 18:59:05.745407 19439 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:05.746425 19446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:05.746356 19438 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deb6828c164f4f60b85479448e800a32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb6828c164f4f60b85479448e800a32" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38649 } } }
I20260811 18:59:05.746691 19438 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:05.752964 19446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:05.763159 19446 catalog_manager.cc:1347] Generated new cluster ID: 3568035c72fa4aa0a1bb2d7341f14b63
I20260811 18:59:05.763311 19446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:05.779855 19446 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:05.781338 19446 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:05.798347 19446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: Generated new TSK 0
I20260811 18:59:05.799422 19446 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.155.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
Entry for principal kudu/127.19.155.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab.
I20260811 18:59:05.878674 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:06.263957 19473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:06.264323 19473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:06.264503 19473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:06.272212 19473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:06.272408 19473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:06.272585 19473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:59:06.282868 19473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.193.keytab
--principal=kudu/127.19.155.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:06.284392 19473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:06.285775 19473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:06.306001 19485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:06.305965 19486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:06.306075 19489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:06.307585 19473 server_base.cc:1034] running on GCE node
I20260811 18:59:06.308373 19473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:06.309573 19473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:06.310822 19473 hybrid_clock.cc:648] HybridClock initialized: now 1786474746310752 us; error 65 us; skew 500 ppm
I20260811 18:59:06.311189 19473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:06 dist-test-slave-1nl6 krb5kdc[19285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:06.314558 19473 init.cc:377] Logged in from keytab as kudu/127.19.155.193@KRBTEST.COM (short username kudu)
I20260811 18:59:06.316314 19473 webserver.cc:460] Webserver started at http://127.19.155.193:37633/ using document root <none> and password file <none>
I20260811 18:59:06.317077 19473 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:06.317236 19473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:06.317584 19473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:06.320838 19473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "da7bb6c5235b4945aeb19162cf631a7e"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "b400bb683082faac1d2fababc5b89ec2"
server_key_iv: "147cf03db67b5994a4bd9e5e00296cc6"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.321683 19473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "da7bb6c5235b4945aeb19162cf631a7e"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "b400bb683082faac1d2fababc5b89ec2"
server_key_iv: "147cf03db67b5994a4bd9e5e00296cc6"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.327359 19473 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260811 18:59:06.331070 19501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.332438 19473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:06.332643 19473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "da7bb6c5235b4945aeb19162cf631a7e"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "b400bb683082faac1d2fababc5b89ec2"
server_key_iv: "147cf03db67b5994a4bd9e5e00296cc6"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.332890 19473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:06.351665 19473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:06.356536 19473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:06.356886 19473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:06.357980 19473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:06.359534 19473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:06.359647 19473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.359818 19473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:06.359896 19473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.396508 19473 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:35165
I20260811 18:59:06.396544 19684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:35165 every 8 connection(s)
I20260811 18:59:06.397998 19473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:59:06.406630 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 19473
I20260811 18:59:06.406853 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:59:06.407366 20079 external_mini_cluster.cc:1428] Setting key 9e2a91421aa8d08637058181ef92b4e8
Aug 11 18:59:06 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.193@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:06.422012 19689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:06.400770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:39585 (local address 127.19.155.254:38649)
0811 18:59:06.401273 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:06.401278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:06.402197 (+ 919us) server_negotiation.cc:407] Connection header received
0811 18:59:06.404264 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:06.404270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:06.404376 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:06.404509 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:06.406247 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:06.407131 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:06.409457 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:06.409895 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:06.410041 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:06.414214 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:06.414225 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:06.414233 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:06.414283 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:06.418158 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:06.419157 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:06.419166 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:06.419172 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:06.419358 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:06.419836 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:06.419844 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:06.419849 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:06.420267 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:06.420443 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:06.421227 (+ 784us) server_negotiation.cc:299] Negotiation successful
0811 18:59:06.421533 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":270,"threads_started":1}
I20260811 18:59:06.422796 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:06.401229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38649 (local address 127.19.155.193:39585)
0811 18:59:06.402009 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:06.402050 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:06.403926 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:06.404795 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:06.404804 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:06.405407 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:06.406030 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:06.406050 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:06.407336 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:06.407341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:06.409292 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:06.409310 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:06.410208 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:06.410224 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:06.410486 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:06.411320 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:06.411351 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:06.413920 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:06.418362 (+ 4442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:06.418372 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:06.418389 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:06.419011 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:06.419478 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:06.419482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:06.419484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:06.419701 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:06.420397 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:06.420404 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:06.420795 (+ 391us) client_negotiation.cc:769] Sending connection context
0811 18:59:06.421043 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 18:59:06.421492 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":296,"threads_started":1}
I20260811 18:59:06.424623 19685 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38649
I20260811 18:59:06.425022 19685 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:06.426036 19685 heartbeater.cc:511] Master 127.19.155.254:38649 requested a full tablet report, sending...
I20260811 18:59:06.428406 19362 ts_manager.cc:194] Registered new tserver with Master: da7bb6c5235b4945aeb19162cf631a7e (127.19.155.193:35165)
I20260811 18:59:06.429978 19362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.193@KRBTEST.COM'} at 127.19.155.193:39585
WARNING: no policy specified for kudu/127.19.155.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
Entry for principal kudu/127.19.155.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab.
I20260811 18:59:06.486582 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:06.860037 19694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:06.860347 19694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:06.860508 19694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:06.868463 19694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:06.868635 19694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:06.868832 19694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:59:06.879179 19694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.194.keytab
--principal=kudu/127.19.155.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:06.880637 19694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:06.882028 19694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:06.895849 19701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:06.895805 19705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:06.895773 19700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:06.897289 19694 server_base.cc:1034] running on GCE node
I20260811 18:59:06.897989 19694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:06.899128 19694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:06.900369 19694 hybrid_clock.cc:648] HybridClock initialized: now 1786474746900301 us; error 65 us; skew 500 ppm
I20260811 18:59:06.900748 19694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:06 dist-test-slave-1nl6 krb5kdc[19285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:06.904161 19694 init.cc:377] Logged in from keytab as kudu/127.19.155.194@KRBTEST.COM (short username kudu)
I20260811 18:59:06.905795 19694 webserver.cc:460] Webserver started at http://127.19.155.194:36413/ using document root <none> and password file <none>
I20260811 18:59:06.906559 19694 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:06.906721 19694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:06.907140 19694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:06.910334 19694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "01e1aa4d0fe543048265d9fa1111f2a5"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "a215e5af964c9e5f6ee171ce70a45a26"
server_key_iv: "ef3235fcd05ab16d634784329ecdee18"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.911260 19694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "01e1aa4d0fe543048265d9fa1111f2a5"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "a215e5af964c9e5f6ee171ce70a45a26"
server_key_iv: "ef3235fcd05ab16d634784329ecdee18"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.916882 19694 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:59:06.920765 19716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.922188 19694 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:59:06.922396 19694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "01e1aa4d0fe543048265d9fa1111f2a5"
format_stamp: "Formatted at 2026-08-11 18:59:06 on dist-test-slave-1nl6"
server_key: "a215e5af964c9e5f6ee171ce70a45a26"
server_key_iv: "ef3235fcd05ab16d634784329ecdee18"
server_key_version: "encryptionkey@0"
I20260811 18:59:06.922634 19694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:06.947239 19694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:06.951879 19694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:06.952220 19694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:06.953352 19694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:06.954779 19694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:06.954893 19694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.955076 19694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:06.955152 19694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:06.990662 19694 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:45115
I20260811 18:59:06.990763 19935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:45115 every 8 connection(s)
I20260811 18:59:06.992198 19694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:59:06.992515 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 19694
I20260811 18:59:06.992710 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:59:06.993300 20079 external_mini_cluster.cc:1428] Setting key 883fcf85bc66b47544cb5be45a8e700c
Aug 11 18:59:07 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474746, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.194@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:07.017242 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:06.995283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:35651 (local address 127.19.155.254:38649)
0811 18:59:06.995814 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:06.995821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:06.997107 (+ 1286us) server_negotiation.cc:407] Connection header received
0811 18:59:06.999134 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:06.999143 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:06.999254 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:06.999380 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:07.001132 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.001917 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.004366 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.005209 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.005392 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.010338 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:07.010345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:07.010352 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:07.010394 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:07.013421 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.014536 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.014540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.014542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.014678 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.015283 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.015286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.015288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.015588 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:07.015706 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.016770 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.016960 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":265,"threads_started":1}
I20260811 18:59:07.019011 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:06.996024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38649 (local address 127.19.155.194:35651)
0811 18:59:06.996919 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:06.996972 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:06.998775 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:06.999657 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:06.999667 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.000284 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:07.000928 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.000948 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.002151 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.002159 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.004155 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.004182 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.005490 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.005498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.005821 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.006690 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:07.006726 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:07.010039 (+ 3313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:07.013610 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:07.013624 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:07.013647 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:07.014388 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:07.014820 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:07.014829 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:07.014835 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:07.015156 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:07.015747 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:07.015765 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:07.016348 (+ 583us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.016693 (+ 345us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.017332 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":376,"threads_started":1}
I20260811 18:59:07.020839 19936 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38649
I20260811 18:59:07.021202 19936 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:07.022023 19936 heartbeater.cc:511] Master 127.19.155.254:38649 requested a full tablet report, sending...
I20260811 18:59:07.023754 19362 ts_manager.cc:194] Registered new tserver with Master: 01e1aa4d0fe543048265d9fa1111f2a5 (127.19.155.194:45115)
I20260811 18:59:07.024636 19362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.194@KRBTEST.COM'} at 127.19.155.194:35651
WARNING: no policy specified for kudu/127.19.155.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
Entry for principal kudu/127.19.155.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab.
I20260811 18:59:07.075699 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:32823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:59:07.433435 19685 heartbeater.cc:503] Master 127.19.155.254:38649 was elected leader, sending a full tablet report...
W20260811 18:59:07.454867 19947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:07.455350 19947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:07.455529 19947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:07.463135 19947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:07.463323 19947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:07.463526 19947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:59:07.473886 19947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:32823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.195.keytab
--principal=kudu/127.19.155.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:38649
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:07.475566 19947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:07.477020 19947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:07.491501 19956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:07.491385 19959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:07.491385 19957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:07.492887 19947 server_base.cc:1034] running on GCE node
I20260811 18:59:07.493584 19947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:07.494609 19947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:07.495894 19947 hybrid_clock.cc:648] HybridClock initialized: now 1786474747495827 us; error 52 us; skew 500 ppm
I20260811 18:59:07.496331 19947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:07 dist-test-slave-1nl6 krb5kdc[19285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:07.499867 19947 init.cc:377] Logged in from keytab as kudu/127.19.155.195@KRBTEST.COM (short username kudu)
I20260811 18:59:07.501729 19947 webserver.cc:460] Webserver started at http://127.19.155.195:35185/ using document root <none> and password file <none>
I20260811 18:59:07.502734 19947 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:07.502897 19947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:07.503314 19947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:07.506649 19947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "03d0cdedabca4fa38a530f7d6d9451cd"
format_stamp: "Formatted at 2026-08-11 18:59:07 on dist-test-slave-1nl6"
server_key: "c408d7adcf75540690f6c6cc4e1de7eb"
server_key_iv: "b52a336f103581be4d852eec1e3af4fd"
server_key_version: "encryptionkey@0"
I20260811 18:59:07.507627 19947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "03d0cdedabca4fa38a530f7d6d9451cd"
format_stamp: "Formatted at 2026-08-11 18:59:07 on dist-test-slave-1nl6"
server_key: "c408d7adcf75540690f6c6cc4e1de7eb"
server_key_iv: "b52a336f103581be4d852eec1e3af4fd"
server_key_version: "encryptionkey@0"
I20260811 18:59:07.514139 19947 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260811 18:59:07.518218 19977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:07.519898 19947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 18:59:07.520120 19947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "03d0cdedabca4fa38a530f7d6d9451cd"
format_stamp: "Formatted at 2026-08-11 18:59:07 on dist-test-slave-1nl6"
server_key: "c408d7adcf75540690f6c6cc4e1de7eb"
server_key_iv: "b52a336f103581be4d852eec1e3af4fd"
server_key_version: "encryptionkey@0"
I20260811 18:59:07.520383 19947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:07.536657 19947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:07.541441 19947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:07.541796 19947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:07.543301 19947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:07.544983 19947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:07.545110 19947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:07.545289 19947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:07.545374 19947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:07.582305 19947 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:38609
I20260811 18:59:07.582346 20172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:38609 every 8 connection(s)
I20260811 18:59:07.583894 19947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:59:07.594000 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 19947
I20260811 18:59:07.594219 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:59:07.594703 20079 external_mini_cluster.cc:1428] Setting key ee22fd87e55f7e2cbadcece66437cdc1
Aug 11 18:59:07 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474747, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.195@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:07.606743 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.586947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:51635 (local address 127.19.155.254:38649)
0811 18:59:07.587480 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.587486 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.588482 (+ 996us) server_negotiation.cc:407] Connection header received
0811 18:59:07.590512 (+ 2030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.590518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.590633 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.590764 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:07.592576 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.593373 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.595381 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.595959 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.596114 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.600364 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:07.600370 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:07.600373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:07.600412 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:07.603281 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.604147 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.604152 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.604154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.604288 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.604788 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.604792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.604794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.605090 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:07.605273 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.606062 (+ 789us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.606321 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":262,"threads_started":1}
I20260811 18:59:07.607803 20181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.587467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38649 (local address 127.19.155.195:51635)
0811 18:59:07.588279 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.588333 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.590172 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.591096 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.591106 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.591705 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:07.592360 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.592381 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.593556 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.593568 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.595161 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.595176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.596260 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.596267 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.596532 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.597380 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:07.597422 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:07.600088 (+ 2666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:07.603456 (+ 3368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:07.603468 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:07.603488 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:07.603982 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:07.604412 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:07.604417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:07.604421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:07.604646 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:07.605248 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:07.605257 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:07.605669 (+ 412us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.605966 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.606563 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":314,"threads_started":1}
I20260811 18:59:07.609622 20175 heartbeater.cc:347] Connected to a master server at 127.19.155.254:38649
I20260811 18:59:07.610028 20175 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:07.611107 20175 heartbeater.cc:511] Master 127.19.155.254:38649 requested a full tablet report, sending...
I20260811 18:59:07.612747 19362 ts_manager.cc:194] Registered new tserver with Master: 03d0cdedabca4fa38a530f7d6d9451cd (127.19.155.195:38609)
I20260811 18:59:07.613619 19362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.155.195@KRBTEST.COM'} at 127.19.155.195:51635
I20260811 18:59:07.623848 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:59:07.641858 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.628600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35660 (local address 127.19.155.254:38649)
0811 18:59:07.628791 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.628797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.629308 (+ 511us) server_negotiation.cc:407] Connection header received
0811 18:59:07.629458 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.629462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.629547 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.629638 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:07.631218 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.631982 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.633282 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.633732 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.633841 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.636458 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:07.636464 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:07.636467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:07.636504 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:07.639393 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.640124 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.640128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.640130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.640255 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:07.640596 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:07.640599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:07.640601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:07.640926 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:07.641128 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.641436 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.641622 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:59:07.646247 19362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:59:07.653939 19362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:59:07.681648 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.667883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.19.155.194:45115)
0811 18:59:07.668547 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.668557 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.669096 (+ 539us) server_negotiation.cc:407] Connection header received
0811 18:59:07.669204 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.669212 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.669470 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.669671 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:07.671200 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.673401 (+ 2201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.677417 (+ 4016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.679583 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.679795 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.680074 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.681074 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.681291 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":1047,"threads_started":1}
I20260811 18:59:07.682828 20196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.667387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45115 (local address 127.0.0.1:57704)
0811 18:59:07.668625 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.668673 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.668887 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.669735 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.669747 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.670022 (+ 275us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:07.670923 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.670945 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.673656 (+ 2711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.673665 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.677120 (+ 3455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.677144 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.680318 (+ 3174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.680326 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.680693 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.680769 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.682006 (+ 1237us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.682318 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":957,"mutex_wait_us":40,"thread_start_us":794,"threads_started":1}
I20260811 18:59:07.683306 20194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.667444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:38609 (local address 127.0.0.1:51286)
0811 18:59:07.671001 (+ 3557us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.671026 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.671180 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.672471 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.672479 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.672516 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:07.673063 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.673078 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.675984 (+ 2906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.675993 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.679296 (+ 3303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.679321 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.682317 (+ 2996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.682324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.682533 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.682577 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.682677 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.682841 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3356,"mutex_wait_us":1,"thread_start_us":3144,"threads_started":1}
I20260811 18:59:07.683993 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.667785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.19.155.195:38609)
0811 18:59:07.669081 (+ 1296us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.669089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.671343 (+ 2254us) server_negotiation.cc:407] Connection header received
0811 18:59:07.671476 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.671488 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.671822 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.672068 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:07.673356 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.675715 (+ 2359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.679586 (+ 3871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.681636 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.681906 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.682126 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.683457 (+ 1331us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.683654 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1106,"thread_start_us":937,"threads_started":1}
I20260811 18:59:07.687672 19820 tablet_service.cc:1467] Processing CreateTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea (DEFAULT_TABLE table=test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:07.687819 20052 tablet_service.cc:1467] Processing CreateTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea (DEFAULT_TABLE table=test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:07.689043 19820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ec469a48b542ba9a2b50209ed6f1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:07.689267 20052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ec469a48b542ba9a2b50209ed6f1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:07.691898 20201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.669880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:35165 (local address 127.0.0.1:54628)
0811 18:59:07.682530 (+ 12650us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.682552 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.682709 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.684266 (+ 1557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.684273 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.684304 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:07.684637 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.684649 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.686820 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.686827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.688982 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.689000 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.691062 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.691069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.691244 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.691281 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.691379 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.691524 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12498,"thread_start_us":12303,"threads_started":1}
I20260811 18:59:07.692945 20203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.670259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54628 (local address 127.19.155.193:35165)
0811 18:59:07.681523 (+ 11264us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.681533 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.682887 (+ 1354us) server_negotiation.cc:407] Connection header received
0811 18:59:07.683559 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.683569 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.683876 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.684094 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:07.684976 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.686638 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.689215 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.690733 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.692168 (+ 1435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.692355 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.692431 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.692601 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11038,"thread_start_us":11282,"threads_started":1}
I20260811 18:59:07.698951 19575 tablet_service.cc:1467] Processing CreateTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea (DEFAULT_TABLE table=test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:07.700525 19575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ec469a48b542ba9a2b50209ed6f1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:07.714222 20204 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Bootstrap starting.
I20260811 18:59:07.716984 20209 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Bootstrap starting.
I20260811 18:59:07.718431 20210 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Bootstrap starting.
I20260811 18:59:07.719420 20204 tablet_bootstrap.cc:654] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:07.720875 20204 log.cc:824] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:07.720899 20209 tablet_bootstrap.cc:654] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:07.722216 20209 log.cc:824] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:07.722710 20210 tablet_bootstrap.cc:654] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:07.723910 20210 log.cc:824] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:07.724383 20204 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: No bootstrap required, opened a new log
I20260811 18:59:07.724681 20204 ts_tablet_manager.cc:1397] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 18:59:07.726377 20209 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: No bootstrap required, opened a new log
I20260811 18:59:07.726780 20209 ts_tablet_manager.cc:1397] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20260811 18:59:07.733556 20204 raft_consensus.cc:348] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.734032 20204 raft_consensus.cc:374] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:07.734136 20204 raft_consensus.cc:729] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d0cdedabca4fa38a530f7d6d9451cd, State: Initialized, Role: FOLLOWER
I20260811 18:59:07.735097 20204 consensus_queue.cc:260] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.736415 20175 heartbeater.cc:503] Master 127.19.155.254:38649 was elected leader, sending a full tablet report...
I20260811 18:59:07.737188 20204 ts_tablet_manager.cc:1428] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260811 18:59:07.737557 20210 tablet_bootstrap.cc:492] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: No bootstrap required, opened a new log
I20260811 18:59:07.737879 20210 ts_tablet_manager.cc:1397] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.018s
I20260811 18:59:07.739492 20209 raft_consensus.cc:348] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.739979 20209 raft_consensus.cc:374] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:07.740100 20209 raft_consensus.cc:729] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01e1aa4d0fe543048265d9fa1111f2a5, State: Initialized, Role: FOLLOWER
I20260811 18:59:07.740767 20209 consensus_queue.cc:260] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.741986 19936 heartbeater.cc:503] Master 127.19.155.254:38649 was elected leader, sending a full tablet report...
I20260811 18:59:07.742762 20209 ts_tablet_manager.cc:1428] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Time spent starting tablet: real 0.016s user 0.008s sys 0.007s
W20260811 18:59:07.744436 19937 tablet.cc:2369] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:07.748725 20210 raft_consensus.cc:348] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.749169 20210 raft_consensus.cc:374] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:07.749279 20210 raft_consensus.cc:729] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da7bb6c5235b4945aeb19162cf631a7e, State: Initialized, Role: FOLLOWER
I20260811 18:59:07.749989 20210 consensus_queue.cc:260] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.751583 20210 ts_tablet_manager.cc:1428] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
W20260811 18:59:07.835805 20176 tablet.cc:2369] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:07.869652 20224 raft_consensus.cc:482] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:59:07.869978 20224 raft_consensus.cc:504] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.871980 20224 leader_election.cc:288] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01e1aa4d0fe543048265d9fa1111f2a5 (127.19.155.194:45115), 03d0cdedabca4fa38a530f7d6d9451cd (127.19.155.195:38609)
I20260811 18:59:07.882052 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.872540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:54997 (local address 127.19.155.194:45115)
0811 18:59:07.872809 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.872817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.873573 (+ 756us) server_negotiation.cc:407] Connection header received
0811 18:59:07.873965 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.873989 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.874083 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.874190 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:07.875007 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.876177 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.879539 (+ 3362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.880797 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.880975 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.881056 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.881629 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.881784 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:59:07.882050 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.872991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:38743 (local address 127.19.155.195:38609)
0811 18:59:07.873244 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.873253 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.873797 (+ 544us) server_negotiation.cc:407] Connection header received
0811 18:59:07.874085 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.874091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.874174 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.874266 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:07.875109 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.876235 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.879548 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.880801 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.880975 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.881056 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.881617 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.881765 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 18:59:07.882275 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.872200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:45115 (local address 127.19.155.193:54997)
0811 18:59:07.873419 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.873449 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.873713 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.874222 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.874249 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.874281 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:07.874791 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.874811 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.876351 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.876358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.879332 (+ 2974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.879350 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.881110 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.881117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.881366 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.881452 (+ 86us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.881558 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.881744 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1034,"mutex_wait_us":225,"thread_start_us":834,"threads_started":1}
I20260811 18:59:07.882313 20226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.872322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:38609 (local address 127.19.155.193:38743)
0811 18:59:07.873696 (+ 1374us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:07.873713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:07.873918 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:07.874294 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:07.874298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:07.874317 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:07.874938 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.874953 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.876372 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.876375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.879332 (+ 2957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:07.879350 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.881127 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.881133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:07.881366 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.881457 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 18:59:07.881558 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:59:07.881744 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1263,"mutex_wait_us":272,"thread_start_us":1060,"threads_started":1}
I20260811 18:59:07.883603 20092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ec469a48b542ba9a2b50209ed6f1ea" candidate_uuid: "da7bb6c5235b4945aeb19162cf631a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" is_pre_election: true
I20260811 18:59:07.883605 19851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ec469a48b542ba9a2b50209ed6f1ea" candidate_uuid: "da7bb6c5235b4945aeb19162cf631a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" is_pre_election: true
I20260811 18:59:07.884137 20092 raft_consensus.cc:2454] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da7bb6c5235b4945aeb19162cf631a7e in term 0.
I20260811 18:59:07.884141 19851 raft_consensus.cc:2454] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da7bb6c5235b4945aeb19162cf631a7e in term 0.
I20260811 18:59:07.884895 19507 leader_election.cc:302] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01e1aa4d0fe543048265d9fa1111f2a5, 03d0cdedabca4fa38a530f7d6d9451cd, da7bb6c5235b4945aeb19162cf631a7e; no voters:
I20260811 18:59:07.885416 20224 raft_consensus.cc:2781] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:59:07.885555 20224 raft_consensus.cc:482] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:59:07.885700 20224 raft_consensus.cc:3037] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:07.888047 20224 raft_consensus.cc:504] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.888760 20224 leader_election.cc:288] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [CANDIDATE]: Term 1 election: Requested vote from peers 01e1aa4d0fe543048265d9fa1111f2a5 (127.19.155.194:45115), 03d0cdedabca4fa38a530f7d6d9451cd (127.19.155.195:38609)
I20260811 18:59:07.889317 20092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ec469a48b542ba9a2b50209ed6f1ea" candidate_uuid: "da7bb6c5235b4945aeb19162cf631a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03d0cdedabca4fa38a530f7d6d9451cd"
I20260811 18:59:07.889321 19851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ec469a48b542ba9a2b50209ed6f1ea" candidate_uuid: "da7bb6c5235b4945aeb19162cf631a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01e1aa4d0fe543048265d9fa1111f2a5"
I20260811 18:59:07.889559 20092 raft_consensus.cc:3037] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:07.889560 19851 raft_consensus.cc:3037] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:07.893006 20092 raft_consensus.cc:2454] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da7bb6c5235b4945aeb19162cf631a7e in term 1.
I20260811 18:59:07.893006 19851 raft_consensus.cc:2454] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da7bb6c5235b4945aeb19162cf631a7e in term 1.
I20260811 18:59:07.893576 19507 leader_election.cc:302] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01e1aa4d0fe543048265d9fa1111f2a5, da7bb6c5235b4945aeb19162cf631a7e; no voters:
I20260811 18:59:07.893927 20224 raft_consensus.cc:2781] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:07.894392 20224 raft_consensus.cc:686] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 1 LEADER]: Becoming Leader. State: Replica: da7bb6c5235b4945aeb19162cf631a7e, State: Running, Role: LEADER
I20260811 18:59:07.895048 20224 consensus_queue.cc:237] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } }
I20260811 18:59:07.900010 19362 catalog_manager.cc:5495] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to da7bb6c5235b4945aeb19162cf631a7e (127.19.155.193). New cstate: current_term: 1 leader_uuid: "da7bb6c5235b4945aeb19162cf631a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da7bb6c5235b4945aeb19162cf631a7e" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 35165 } health_report { overall_health: HEALTHY } } }
W20260811 18:59:07.900842 19686 tablet.cc:2369] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:07.932842 20203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.927115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.19.155.193:35165)
0811 18:59:07.927337 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.927341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.927360 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:59:07.927672 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.927679 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.927813 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.927956 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:07.928289 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.929057 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.930631 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.931128 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.931265 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.931734 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:07.932321 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:07.932440 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:07.932546 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 18:59:07.932620 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:59:07.942267 20092 raft_consensus.cc:1261] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 1 FOLLOWER]: Refusing update from remote peer da7bb6c5235b4945aeb19162cf631a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:07.942267 19851 raft_consensus.cc:1261] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 1 FOLLOWER]: Refusing update from remote peer da7bb6c5235b4945aeb19162cf631a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:07.943512 20227 consensus_queue.cc:1035] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "01e1aa4d0fe543048265d9fa1111f2a5" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 45115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:07.943914 20224 consensus_queue.cc:1035] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03d0cdedabca4fa38a530f7d6d9451cd" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 38609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:07.972505 19362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:07.972846 19362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:07.977016 19362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P deb6828c164f4f60b85479448e800a32: Sending DeleteTablet for 3 replicas of tablet c7ec469a48b542ba9a2b50209ed6f1ea
I20260811 18:59:07.978379 19820 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:07 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:57704
I20260811 18:59:07.978444 20052 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:07 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:51286
I20260811 18:59:07.979264 19575 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ec469a48b542ba9a2b50209ed6f1ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:07 UTC) from {username='kudu', principal='kudu/127.19.155.254@KRBTEST.COM'} at 127.0.0.1:54628
I20260811 18:59:07.979682 20256 tablet_replica.cc:330] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: stopping tablet replica
I20260811 18:59:07.980238 20260 tablet_replica.cc:330] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: stopping tablet replica
I20260811 18:59:07.980195 20256 raft_consensus.cc:2229] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:07.980645 20260 raft_consensus.cc:2229] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:59:07.980765 20256 raft_consensus.cc:2258] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:07.981012 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 19473
I20260811 18:59:07.981351 20260 raft_consensus.cc:2258] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:07.985091 20260 ts_tablet_manager.cc:1905] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:07.993691 20260 ts_tablet_manager.cc:1918] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:07.994014 20260 log.cc:1196] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-0/wal/wals/c7ec469a48b542ba9a2b50209ed6f1ea
I20260811 18:59:07.994724 20260 ts_tablet_manager.cc:1939] T c7ec469a48b542ba9a2b50209ed6f1ea P da7bb6c5235b4945aeb19162cf631a7e: Deleting consensus metadata
Aug 11 18:59:07 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.193@KRBTEST.COM
I20260811 18:59:07.996986 19335 catalog_manager.cc:4841] TS da7bb6c5235b4945aeb19162cf631a7e (127.19.155.193:35165): tablet c7ec469a48b542ba9a2b50209ed6f1ea (table test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]) successfully deleted
I20260811 18:59:07.999277 20256 ts_tablet_manager.cc:1905] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:08.004858 20203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:07.982400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.19.155.193:35165)
0811 18:59:07.982581 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:07.982588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:07.983136 (+ 548us) server_negotiation.cc:407] Connection header received
0811 18:59:07.983469 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:07.983474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:07.983573 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:07.983653 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:07.986020 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.987800 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.990044 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:07.990814 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:07.990954 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:07.996767 (+ 5813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:07.996786 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:07.996808 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:07.996869 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:08.001012 (+ 4143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.002060 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.002071 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.002075 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.002270 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.002737 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.002742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.002746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.003238 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:08.003565 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:08.004200 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 18:59:08.004483 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:59:08.006984 19678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:08.008963 20256 ts_tablet_manager.cc:1918] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:08.009313 20256 log.cc:1196] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/c7ec469a48b542ba9a2b50209ed6f1ea
I20260811 18:59:08.010185 20256 ts_tablet_manager.cc:1939] T c7ec469a48b542ba9a2b50209ed6f1ea P 01e1aa4d0fe543048265d9fa1111f2a5: Deleting consensus metadata
I20260811 18:59:08.012777 20257 tablet_replica.cc:330] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: stopping tablet replica
I20260811 18:59:08.012996 19336 catalog_manager.cc:4841] TS 01e1aa4d0fe543048265d9fa1111f2a5 (127.19.155.194:45115): tablet c7ec469a48b542ba9a2b50209ed6f1ea (table test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]) successfully deleted
I20260811 18:59:08.013407 20257 raft_consensus.cc:2229] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:08.013999 20257 raft_consensus.cc:2258] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:08.015897 20257 ts_tablet_manager.cc:1905] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:08.024287 20257 ts_tablet_manager.cc:1918] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:08.024544 20257 log.cc:1196] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/c7ec469a48b542ba9a2b50209ed6f1ea
I20260811 18:59:08.025130 20257 ts_tablet_manager.cc:1939] T c7ec469a48b542ba9a2b50209ed6f1ea P 03d0cdedabca4fa38a530f7d6d9451cd: Deleting consensus metadata
I20260811 18:59:08.027621 19339 catalog_manager.cc:4841] TS 03d0cdedabca4fa38a530f7d6d9451cd (127.19.155.195:38609): tablet c7ec469a48b542ba9a2b50209ed6f1ea (table test-table [id=21b7083b29df40b3b40bf0d0d0aceb35]) successfully deleted
I20260811 18:59:08.117522 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 19473
I20260811 18:59:08.152710 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 19694
Aug 11 18:59:08 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.194@KRBTEST.COM
I20260811 18:59:08.168637 20199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:08.153645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.19.155.194:45115)
0811 18:59:08.153838 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:08.153843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:08.153864 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:59:08.153981 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:08.153985 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:08.154059 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:08.154167 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:08.155598 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:08.156405 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:08.157718 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:08.158118 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:08.158217 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:08.162625 (+ 4408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:08.162643 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:08.162661 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:08.162699 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:08.165564 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.166258 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.166265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.166267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.166401 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.166820 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.166823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.166825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.167514 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:08.167766 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:08.168047 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 18:59:08.168230 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 18:59:08.169466 19928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:08.260555 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 19694
I20260811 18:59:08.288874 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 19947
Aug 11 18:59:08 dist-test-slave-1nl6 krb5kdc[19285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.195@KRBTEST.COM
I20260811 18:59:08.305114 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:08.289710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51294 (local address 127.19.155.195:38609)
0811 18:59:08.289901 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:08.289906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:08.289927 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:59:08.290078 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:08.290082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:08.290162 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:08.290258 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:08.291692 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:08.292445 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:08.293713 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:08.294124 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:08.294236 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:08.298984 (+ 4748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:08.299005 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:08.299024 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:08.299069 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:08.301825 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.302702 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.302712 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.302714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.303058 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:08.303449 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:08.303453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:08.303455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:08.303911 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:08.304193 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:08.304646 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 18:59:08.304847 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:59:08.305883 20165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:08.398095 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 19947
I20260811 18:59:08.419353 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 19311
I20260811 18:59:08.420584 19413 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:08.533581 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 19311
2026-08-11T18:59:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5087 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T18:59:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:08Z Disabled control of system clock
I20260811 18:59:08.645201 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40021
--webserver_interface=127.19.155.254
--webserver_port=0
--builtin_ntp_servers=127.19.155.212:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:40021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:59:09.008648 20278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:09.008972 20278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:09.009058 20278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:09.016593 20278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:09.016734 20278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:09.016774 20278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:09.016826 20278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:09.016871 20278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:09.026437 20278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:40021
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:40021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:09.027773 20278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:09.029742 20278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:09.042125 20286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:09.042179 20294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:09.042080 20287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:09.043259 20278 server_base.cc:1034] running on GCE node
I20260811 18:59:09.044183 20278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:09.045760 20278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:09.047022 20278 hybrid_clock.cc:648] HybridClock initialized: now 1786474749046965 us; error 51 us; skew 500 ppm
I20260811 18:59:09.047423 20278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:09.049814 20278 webserver.cc:460] Webserver started at http://127.19.155.254:46433/ using document root <none> and password file <none>
I20260811 18:59:09.050558 20278 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:09.050699 20278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:09.051118 20278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:09.054191 20278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "f968f0ceb6944a91ae759031bca56254"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "64b4d3518896cdcf17b3dd0eea2c8f9e"
server_key_iv: "6f0c814377360532d40a77e5694ebf9d"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.055156 20278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "f968f0ceb6944a91ae759031bca56254"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "64b4d3518896cdcf17b3dd0eea2c8f9e"
server_key_iv: "6f0c814377360532d40a77e5694ebf9d"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.060652 20278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:59:09.064380 20303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:09.065846 20278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:09.066073 20278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "f968f0ceb6944a91ae759031bca56254"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "64b4d3518896cdcf17b3dd0eea2c8f9e"
server_key_iv: "6f0c814377360532d40a77e5694ebf9d"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.066321 20278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:09.086513 20278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:09.087479 20278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:09.087801 20278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:09.107882 20278 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:40021
I20260811 18:59:09.107913 20417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:40021 every 8 connection(s)
I20260811 18:59:09.109398 20278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:09.110580 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20278
I20260811 18:59:09.110773 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:09.111426 20079 external_mini_cluster.cc:1428] Setting key 4e9ef97ba2bce7e53d99f724c006a5b4
I20260811 18:59:09.114259 20418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:09.127159 20422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:09.113587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56332 (local address 127.19.155.254:40021)
0811 18:59:09.114673 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:09.114684 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:09.114730 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:59:09.116559 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:09.116582 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:09.117067 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:09.117535 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:09.118132 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.119636 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.121121 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.121850 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.122064 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:09.123491 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:09.123504 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:09.123528 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:09.124497 (+ 969us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:09.124620 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:09.124655 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:09.124803 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:09.125126 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 18:59:09.125553 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":486,"threads_started":1}
I20260811 18:59:09.127854 20418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: Bootstrap starting.
I20260811 18:59:09.131528 20418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:09.132758 20418 log.cc:824] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:09.136340 20418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: No bootstrap required, opened a new log
I20260811 18:59:09.147563 20418 raft_consensus.cc:348] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } }
I20260811 18:59:09.148092 20418 raft_consensus.cc:374] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:09.148208 20418 raft_consensus.cc:729] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f968f0ceb6944a91ae759031bca56254, State: Initialized, Role: FOLLOWER
I20260811 18:59:09.148916 20418 consensus_queue.cc:260] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } }
I20260811 18:59:09.149192 20418 raft_consensus.cc:388] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:09.149348 20418 raft_consensus.cc:482] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:09.149591 20418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:09.153033 20418 raft_consensus.cc:504] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } }
I20260811 18:59:09.153636 20418 leader_election.cc:302] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f968f0ceb6944a91ae759031bca56254; no voters:
I20260811 18:59:09.154376 20418 leader_election.cc:288] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:09.154625 20428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:09.155603 20428 raft_consensus.cc:686] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [term 1 LEADER]: Becoming Leader. State: Replica: f968f0ceb6944a91ae759031bca56254, State: Running, Role: LEADER
I20260811 18:59:09.156299 20428 consensus_queue.cc:237] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } }
I20260811 18:59:09.156919 20418 sys_catalog.cc:564] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:09.159967 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f968f0ceb6944a91ae759031bca56254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } } }
I20260811 18:59:09.160442 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:09.159941 20433 sys_catalog.cc:455] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f968f0ceb6944a91ae759031bca56254. Latest consensus state: current_term: 1 leader_uuid: "f968f0ceb6944a91ae759031bca56254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f968f0ceb6944a91ae759031bca56254" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 40021 } } }
I20260811 18:59:09.161100 20433 sys_catalog.cc:458] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:09.166448 20443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:09.176066 20443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:09.188268 20443 catalog_manager.cc:1347] Generated new cluster ID: ee07c1c896fe4cad8d61c72b1b227aa0
I20260811 18:59:09.188423 20443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:09.212975 20443 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:09.214993 20443 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:09.229346 20443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: Generated new TSK 0
I20260811 18:59:09.230567 20443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:09.238054 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.193:0
--local_ip_for_outbound_sockets=127.19.155.193
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--builtin_ntp_servers=127.19.155.212:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:59:09.611146 20464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:09.611554 20464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:09.611654 20464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:09.619046 20464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:09.619167 20464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:09.619278 20464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.193
I20260811 18:59:09.629009 20464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.155.193
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.193
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:09.630309 20464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:09.632311 20464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:09.646124 20474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:09.646178 20482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:09.646060 20476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:09.647156 20464 server_base.cc:1034] running on GCE node
I20260811 18:59:09.647857 20464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:09.648830 20464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:09.650048 20464 hybrid_clock.cc:648] HybridClock initialized: now 1786474749649978 us; error 56 us; skew 500 ppm
I20260811 18:59:09.650393 20464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:09.652835 20464 webserver.cc:460] Webserver started at http://127.19.155.193:43579/ using document root <none> and password file <none>
I20260811 18:59:09.653576 20464 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:09.653704 20464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:09.654064 20464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:09.657267 20464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data/instance:
uuid: "d9a2de91efe0467e962489193f51360f"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "15fc28feb9a5acb4c3a64caee105691f"
server_key_iv: "ed1410458ca5c8a8b371ffa3460d591e"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.658253 20464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance:
uuid: "d9a2de91efe0467e962489193f51360f"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "15fc28feb9a5acb4c3a64caee105691f"
server_key_iv: "ed1410458ca5c8a8b371ffa3460d591e"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.663723 20464 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:59:09.667547 20492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:09.668924 20464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:09.669109 20464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal
uuid: "d9a2de91efe0467e962489193f51360f"
format_stamp: "Formatted at 2026-08-11 18:59:09 on dist-test-slave-1nl6"
server_key: "15fc28feb9a5acb4c3a64caee105691f"
server_key_iv: "ed1410458ca5c8a8b371ffa3460d591e"
server_key_version: "encryptionkey@0"
I20260811 18:59:09.669350 20464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:09.694605 20464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:09.695566 20464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:09.695906 20464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:09.696967 20464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:09.698549 20464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:09.698673 20464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:09.698822 20464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:09.698944 20464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:09.733989 20464 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.193:46341
I20260811 18:59:09.734047 20698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.193:46341 every 8 connection(s)
I20260811 18:59:09.735519 20464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/data/info.pb
I20260811 18:59:09.744268 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20464
I20260811 18:59:09.744469 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-0/wal/instance
I20260811 18:59:09.744939 20079 external_mini_cluster.cc:1428] Setting key 3fd602d4938f869ee98c6684cb2f4335
I20260811 18:59:09.748054 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.194:0
--local_ip_for_outbound_sockets=127.19.155.194
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--builtin_ntp_servers=127.19.155.212:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:59:09.749305 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:09.738158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:58509 (local address 127.19.155.254:40021)
0811 18:59:09.738640 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:09.738647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:09.739940 (+ 1293us) server_negotiation.cc:407] Connection header received
0811 18:59:09.741746 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:09.741751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:09.741836 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:09.741943 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:09.743201 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.744101 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.746005 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.746464 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.746571 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:09.748418 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:09.748423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:09.748426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:09.748445 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:09.748487 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:09.748499 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:09.748596 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:09.748852 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 18:59:09.748959 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":227,"threads_started":1}
I20260811 18:59:09.750389 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:09.738789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40021 (local address 127.19.155.193:58509)
0811 18:59:09.739765 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:09.739802 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:09.741465 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:09.742166 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:09.742175 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:09.742275 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:09.743028 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:09.743050 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.744267 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.744271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:09.745866 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:09.745879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:09.746820 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:09.746842 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:09.747229 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:09.747999 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:09.748002 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:09.748046 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:09.748173 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:09.748612 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:09.748625 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:09.748636 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 18:59:09.748824 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 18:59:09.749268 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":289,"threads_started":1}
I20260811 18:59:09.752264 20699 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40021
I20260811 18:59:09.752612 20699 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:09.753418 20699 heartbeater.cc:511] Master 127.19.155.254:40021 requested a full tablet report, sending...
I20260811 18:59:09.756002 20340 ts_manager.cc:194] Registered new tserver with Master: d9a2de91efe0467e962489193f51360f (127.19.155.193:46341)
I20260811 18:59:09.758344 20340 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.193:58509
W20260811 18:59:10.116283 20706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:10.116596 20706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:10.116739 20706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:10.124456 20706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:10.124577 20706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:10.124754 20706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.194
I20260811 18:59:10.135836 20706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.155.194
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.194
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:10.137392 20706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:10.140148 20706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:10.158042 20714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:10.158083 20722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:10.158128 20718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:10.159258 20706 server_base.cc:1034] running on GCE node
I20260811 18:59:10.159915 20706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:10.160938 20706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:10.162174 20706 hybrid_clock.cc:648] HybridClock initialized: now 1786474750162118 us; error 47 us; skew 500 ppm
I20260811 18:59:10.162523 20706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:10.164999 20706 webserver.cc:460] Webserver started at http://127.19.155.194:33043/ using document root <none> and password file <none>
I20260811 18:59:10.165748 20706 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:10.165892 20706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:10.166226 20706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:10.169484 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data/instance:
uuid: "c9dc8d3bb138436f9e481078636e99e2"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "f910485a5ad8dce0d1f446ac807319ee"
server_key_iv: "288e91806ff26d8321868b4dd789467a"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.170342 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance:
uuid: "c9dc8d3bb138436f9e481078636e99e2"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "f910485a5ad8dce0d1f446ac807319ee"
server_key_iv: "288e91806ff26d8321868b4dd789467a"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.175931 20706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 18:59:10.179531 20736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.180886 20706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 18:59:10.181087 20706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal
uuid: "c9dc8d3bb138436f9e481078636e99e2"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "f910485a5ad8dce0d1f446ac807319ee"
server_key_iv: "288e91806ff26d8321868b4dd789467a"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.181326 20706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:10.195721 20706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:10.196650 20706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:10.196990 20706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:10.198047 20706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:10.199642 20706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:10.199771 20706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.199920 20706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:10.200013 20706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.235159 20706 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.194:33367
I20260811 18:59:10.235212 20926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.194:33367 every 8 connection(s)
I20260811 18:59:10.236685 20706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/data/info.pb
I20260811 18:59:10.242089 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20706
I20260811 18:59:10.242303 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal/instance
I20260811 18:59:10.242878 20079 external_mini_cluster.cc:1428] Setting key d33a627070f2f6cafbde6c86aa5933c4
I20260811 18:59:10.246196 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.155.195:0
--local_ip_for_outbound_sockets=127.19.155.195
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--builtin_ntp_servers=127.19.155.212:39359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:59:10.252636 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.239595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.194:53639 (local address 127.19.155.254:40021)
0811 18:59:10.239844 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.239851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.241434 (+ 1583us) server_negotiation.cc:407] Connection header received
0811 18:59:10.244008 (+ 2574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.244013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.244149 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.244266 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:10.245701 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.246569 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.249334 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.249757 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.249864 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.251835 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:10.251840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:10.251843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:10.251865 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:10.251900 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:10.251912 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:10.251992 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.252296 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.252394 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:59:10.254261 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.240263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40021 (local address 127.19.155.194:53639)
0811 18:59:10.241239 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:10.241278 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:10.243649 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:10.244507 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:10.244517 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:10.244613 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:10.245502 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.245531 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.246733 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.246742 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.249129 (+ 2387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.249150 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.250019 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.250029 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.250399 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.251388 (+ 989us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:10.251394 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:10.251459 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:10.251580 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:10.252019 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:10.252032 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:10.252044 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:59:10.252264 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 18:59:10.252754 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":320,"threads_started":1}
I20260811 18:59:10.255870 20927 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40021
I20260811 18:59:10.256242 20927 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:10.257272 20927 heartbeater.cc:511] Master 127.19.155.254:40021 requested a full tablet report, sending...
I20260811 18:59:10.259107 20340 ts_manager.cc:194] Registered new tserver with Master: c9dc8d3bb138436f9e481078636e99e2 (127.19.155.194:33367)
I20260811 18:59:10.259923 20340 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.194:53639
W20260811 18:59:10.610458 20931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:10.610786 20931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:10.610976 20931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:10.618439 20931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:10.618610 20931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:10.618834 20931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.155.195
I20260811 18:59:10.628376 20931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.155.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.155.195
--webserver_port=0
--tserver_master_addrs=127.19.155.254:40021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.155.195
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:10.629834 20931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:10.631778 20931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:10.646266 20943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:10.646317 20945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:10.646353 20947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:10.647496 20931 server_base.cc:1034] running on GCE node
I20260811 18:59:10.648160 20931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:10.649214 20931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:10.650441 20931 hybrid_clock.cc:648] HybridClock initialized: now 1786474750650383 us; error 43 us; skew 500 ppm
I20260811 18:59:10.650840 20931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 18:59:10.657665 20931 webserver.cc:460] Webserver started at http://127.19.155.195:34649/ using document root <none> and password file <none>
I20260811 18:59:10.658536 20931 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:10.658701 20931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:10.659162 20931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:10.662324 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data/instance:
uuid: "9030c6ceef774f2eb5f15b59a4370f32"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "766e427e49052778fe743a8b39e35919"
server_key_iv: "2e643f59ffb424d6aa7c72ab29f451f0"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.663317 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance:
uuid: "9030c6ceef774f2eb5f15b59a4370f32"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "766e427e49052778fe743a8b39e35919"
server_key_iv: "2e643f59ffb424d6aa7c72ab29f451f0"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.669275 20931 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:59:10.673646 20956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.675549 20931 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:59:10.675774 20931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal
uuid: "9030c6ceef774f2eb5f15b59a4370f32"
format_stamp: "Formatted at 2026-08-11 18:59:10 on dist-test-slave-1nl6"
server_key: "766e427e49052778fe743a8b39e35919"
server_key_iv: "2e643f59ffb424d6aa7c72ab29f451f0"
server_key_version: "encryptionkey@0"
I20260811 18:59:10.676033 20931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:10.698086 20931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:10.699054 20931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:10.699407 20931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:10.700529 20931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:59:10.702167 20931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:59:10.702299 20931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.702452 20931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:59:10.702548 20931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:10.738976 20931 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.195:40779
I20260811 18:59:10.739082 21155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.195:40779 every 8 connection(s)
I20260811 18:59:10.740372 20931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/data/info.pb
I20260811 18:59:10.743928 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 20931
I20260811 18:59:10.744127 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal/instance
I20260811 18:59:10.744762 20079 external_mini_cluster.cc:1428] Setting key 5c446854632f0d52d45e10a113c97333
I20260811 18:59:10.754666 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.743292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.195:41905 (local address 127.19.155.254:40021)
0811 18:59:10.743498 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.743503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.745466 (+ 1963us) server_negotiation.cc:407] Connection header received
0811 18:59:10.747956 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.747963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.748060 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.748147 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:10.749363 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.750099 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.751813 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.752233 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.752354 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.753916 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:10.753922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:10.753925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:10.753945 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:10.753978 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:10.753990 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:10.754062 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.754285 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.754379 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 18:59:10.755896 21161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.743920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:40021 (local address 127.19.155.195:41905)
0811 18:59:10.745226 (+ 1306us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:10.745297 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:10.747585 (+ 2288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:10.748429 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:10.748439 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:10.748542 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:10.749199 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.749219 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.750245 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.750249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.751663 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.751677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.752516 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.752527 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.752852 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.753562 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:59:10.753565 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:10.753610 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:59:10.753710 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:10.754079 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:10.754088 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:10.754095 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:59:10.754256 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 18:59:10.754620 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":394,"threads_started":1}
I20260811 18:59:10.757445 21156 heartbeater.cc:347] Connected to a master server at 127.19.155.254:40021
I20260811 18:59:10.757787 21156 heartbeater.cc:464] Registering TS with master...
I20260811 18:59:10.758620 21156 heartbeater.cc:511] Master 127.19.155.254:40021 requested a full tablet report, sending...
I20260811 18:59:10.760370 20340 ts_manager.cc:194] Registered new tserver with Master: 9030c6ceef774f2eb5f15b59a4370f32 (127.19.155.195:40779)
I20260811 18:59:10.761183 20340 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.155.195:41905
I20260811 18:59:10.761929 20699 heartbeater.cc:503] Master 127.19.155.254:40021 was elected leader, sending a full tablet report...
I20260811 18:59:10.773527 20079 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:59:10.784477 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.778223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56334 (local address 127.19.155.254:40021)
0811 18:59:10.778411 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.778416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.778868 (+ 452us) server_negotiation.cc:407] Connection header received
0811 18:59:10.779090 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.779094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.779181 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.779275 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:10.779805 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.780565 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.782129 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.782559 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.782658 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.783829 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:10.783844 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:10.783849 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:10.783877 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:10.783914 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:10.783928 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:10.784001 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.784151 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.784231 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:59:10.788707 20340 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:59:10.796005 20340 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:59:10.821998 21178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.809515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33367 (local address 127.0.0.1:44480)
0811 18:59:10.811161 (+ 1646us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:10.811228 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:10.811461 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:10.814375 (+ 2914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:10.814383 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:10.814412 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:10.814989 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.815002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.816434 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.816440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.819326 (+ 2886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.819353 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.820868 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.820875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.821098 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.821153 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:59:10.821308 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:59:10.821536 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1276,"mutex_wait_us":208,"thread_start_us":1060,"threads_started":1}
I20260811 18:59:10.822643 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.809916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:40779 (local address 127.0.0.1:58028)
0811 18:59:10.812782 (+ 2866us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:10.812804 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:10.812950 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:10.814109 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:10.814117 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:10.814149 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:10.814678 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.814696 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.817094 (+ 2398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.817102 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.819283 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.819298 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.821640 (+ 2342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.821649 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.821906 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.822001 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 18:59:10.822096 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 18:59:10.822252 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2698,"mutex_wait_us":216,"thread_start_us":2538,"threads_started":1}
I20260811 18:59:10.823100 21179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.809689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44480 (local address 127.19.155.194:33367)
0811 18:59:10.813792 (+ 4103us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.813810 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.813851 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:59:10.813942 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.813949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.814160 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.815177 (+ 1017us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:10.815365 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.816264 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.819638 (+ 3374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.820650 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.820866 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.821144 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.822502 (+ 1358us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.822731 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3945,"thread_start_us":4372,"threads_started":1}
I20260811 18:59:10.823032 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.812233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54066)
0811 18:59:10.813136 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:10.813156 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:10.813291 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:10.814207 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:10.814217 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:10.814247 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:10.814893 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.814937 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.816960 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.816968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.819487 (+ 2519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:10.819503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.821701 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.821707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:10.821921 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.822016 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 18:59:10.822401 (+ 385us) client_negotiation.cc:240] Negotiation successful
0811 18:59:10.822533 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":91,"thread_start_us":625,"threads_started":1}
I20260811 18:59:10.823587 21181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.810704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.19.155.195:40779)
0811 18:59:10.812276 (+ 1572us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.812287 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.813116 (+ 829us) server_negotiation.cc:407] Connection header received
0811 18:59:10.813236 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.813244 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.813545 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.813747 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:10.814945 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.816677 (+ 1732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.819513 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.821021 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.821238 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.821491 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.823006 (+ 1515us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.823197 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1347,"thread_start_us":1169,"threads_started":1}
I20260811 18:59:10.824100 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:10.812579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.19.155.193:46341)
0811 18:59:10.813600 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:10.813609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:10.813637 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:59:10.813738 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:10.813745 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:10.813970 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:10.815015 (+ 1045us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:10.815260 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.816770 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.819699 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:10.821197 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:10.821396 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:10.821577 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:10.822757 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0811 18:59:10.822980 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":1671,"threads_started":1}
I20260811 18:59:10.827646 21033 tablet_service.cc:1467] Processing CreateTablet for tablet 78f3656803944228951b8905a6c360f1 (DEFAULT_TABLE table=test-table [id=468f720829374d488c5bdbd0a0983273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:10.827646 20822 tablet_service.cc:1467] Processing CreateTablet for tablet 78f3656803944228951b8905a6c360f1 (DEFAULT_TABLE table=test-table [id=468f720829374d488c5bdbd0a0983273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:10.829452 20822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f3656803944228951b8905a6c360f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:10.829452 21033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f3656803944228951b8905a6c360f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:10.830029 20589 tablet_service.cc:1467] Processing CreateTablet for tablet 78f3656803944228951b8905a6c360f1 (DEFAULT_TABLE table=test-table [id=468f720829374d488c5bdbd0a0983273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:59:10.831583 20589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f3656803944228951b8905a6c360f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:10.844763 21184 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Bootstrap starting.
I20260811 18:59:10.847126 21185 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Bootstrap starting.
I20260811 18:59:10.848426 21186 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Bootstrap starting.
I20260811 18:59:10.849084 21184 tablet_bootstrap.cc:654] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:10.850871 21184 log.cc:824] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:10.851677 21185 tablet_bootstrap.cc:654] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:10.852340 21186 tablet_bootstrap.cc:654] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:10.853078 21185 log.cc:824] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:10.853577 21186 log.cc:824] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:10.854853 21184 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: No bootstrap required, opened a new log
I20260811 18:59:10.855257 21184 ts_tablet_manager.cc:1397] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260811 18:59:10.858098 21185 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: No bootstrap required, opened a new log
I20260811 18:59:10.858098 21186 tablet_bootstrap.cc:492] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: No bootstrap required, opened a new log
I20260811 18:59:10.858435 21186 ts_tablet_manager.cc:1397] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260811 18:59:10.858435 21185 ts_tablet_manager.cc:1397] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260811 18:59:10.864074 21184 raft_consensus.cc:348] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.864537 21184 raft_consensus.cc:374] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:10.864684 21184 raft_consensus.cc:729] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a2de91efe0467e962489193f51360f, State: Initialized, Role: FOLLOWER
I20260811 18:59:10.865404 21184 consensus_queue.cc:260] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.867447 21184 ts_tablet_manager.cc:1428] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260811 18:59:10.870016 21185 raft_consensus.cc:348] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.870016 21186 raft_consensus.cc:348] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.870537 21185 raft_consensus.cc:374] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:10.870537 21186 raft_consensus.cc:374] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:10.870654 21186 raft_consensus.cc:729] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9030c6ceef774f2eb5f15b59a4370f32, State: Initialized, Role: FOLLOWER
I20260811 18:59:10.870718 21185 raft_consensus.cc:729] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9dc8d3bb138436f9e481078636e99e2, State: Initialized, Role: FOLLOWER
I20260811 18:59:10.871444 21186 consensus_queue.cc:260] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.871439 21185 consensus_queue.cc:260] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:10.873284 20927 heartbeater.cc:503] Master 127.19.155.254:40021 was elected leader, sending a full tablet report...
I20260811 18:59:10.873651 21186 ts_tablet_manager.cc:1428] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Time spent starting tablet: real 0.015s user 0.014s sys 0.002s
I20260811 18:59:10.873822 21185 ts_tablet_manager.cc:1428] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260811 18:59:10.874195 21156 heartbeater.cc:503] Master 127.19.155.254:40021 was elected leader, sending a full tablet report...
W20260811 18:59:10.988217 20700 tablet.cc:2369] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:59:10.988898 20929 tablet.cc:2369] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:59:10.992213 21160 tablet.cc:2369] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:11.026021 21194 raft_consensus.cc:482] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:59:11.026393 21194 raft_consensus.cc:504] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:11.028295 21194 leader_election.cc:288] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9dc8d3bb138436f9e481078636e99e2 (127.19.155.194:33367), 9030c6ceef774f2eb5f15b59a4370f32 (127.19.155.195:40779)
I20260811 18:59:11.035959 21181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.028882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:41425 (local address 127.19.155.195:40779)
0811 18:59:11.029136 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.029145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.030167 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 18:59:11.030383 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.030388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.030452 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.030552 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:11.031238 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.031982 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.034137 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.035046 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.035225 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.035296 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.035579 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.035712 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:59:11.035959 21179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.028841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.155.193:46451 (local address 127.19.155.194:33367)
0811 18:59:11.029083 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.029092 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.030037 (+ 945us) server_negotiation.cc:407] Connection header received
0811 18:59:11.030283 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.030288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.030365 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.030467 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:59:11.031294 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.031985 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.034145 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.034980 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.035161 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.035238 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.035531 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.035666 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:59:11.036082 21199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.028848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.195:40779 (local address 127.19.155.193:41425)
0811 18:59:11.030033 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.030048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:11.030207 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:11.030567 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:11.030571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:11.030599 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:11.031020 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:11.031034 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.032125 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.032144 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:11.033906 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:11.033920 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.035246 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.035252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:11.035412 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.035435 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:59:11.035546 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 18:59:11.035678 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"mutex_wait_us":118,"thread_start_us":553,"threads_started":1}
I20260811 18:59:11.036108 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.028600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.194:33367 (local address 127.19.155.193:46451)
0811 18:59:11.029902 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.029925 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:11.030119 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:11.030485 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:11.030489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:11.030514 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:59:11.031132 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:11.031144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.032121 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.032141 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:11.033914 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:11.033927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.035186 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.035193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:11.035358 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.035383 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 18:59:11.035499 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:59:11.035644 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1072,"mutex_wait_us":131,"spinlock_wait_cycles":25984,"thread_start_us":878,"threads_started":1}
I20260811 18:59:11.037374 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f3656803944228951b8905a6c360f1" candidate_uuid: "d9a2de91efe0467e962489193f51360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9dc8d3bb138436f9e481078636e99e2" is_pre_election: true
I20260811 18:59:11.037474 21068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f3656803944228951b8905a6c360f1" candidate_uuid: "d9a2de91efe0467e962489193f51360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9030c6ceef774f2eb5f15b59a4370f32" is_pre_election: true
I20260811 18:59:11.037974 20854 raft_consensus.cc:2454] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a2de91efe0467e962489193f51360f in term 0.
I20260811 18:59:11.038002 21068 raft_consensus.cc:2454] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a2de91efe0467e962489193f51360f in term 0.
I20260811 18:59:11.038729 20494 leader_election.cc:302] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9030c6ceef774f2eb5f15b59a4370f32, c9dc8d3bb138436f9e481078636e99e2, d9a2de91efe0467e962489193f51360f; no voters:
I20260811 18:59:11.039206 21194 raft_consensus.cc:2781] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:59:11.039373 21194 raft_consensus.cc:482] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:59:11.039495 21194 raft_consensus.cc:3037] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:11.041905 21194 raft_consensus.cc:504] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:11.042660 21194 leader_election.cc:288] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [CANDIDATE]: Term 1 election: Requested vote from peers c9dc8d3bb138436f9e481078636e99e2 (127.19.155.194:33367), 9030c6ceef774f2eb5f15b59a4370f32 (127.19.155.195:40779)
I20260811 18:59:11.043175 20854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f3656803944228951b8905a6c360f1" candidate_uuid: "d9a2de91efe0467e962489193f51360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9dc8d3bb138436f9e481078636e99e2"
I20260811 18:59:11.043232 21068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f3656803944228951b8905a6c360f1" candidate_uuid: "d9a2de91efe0467e962489193f51360f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9030c6ceef774f2eb5f15b59a4370f32"
I20260811 18:59:11.043413 20854 raft_consensus.cc:3037] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:11.043447 21068 raft_consensus.cc:3037] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:11.045684 21068 raft_consensus.cc:2454] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a2de91efe0467e962489193f51360f in term 1.
I20260811 18:59:11.045704 20854 raft_consensus.cc:2454] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a2de91efe0467e962489193f51360f in term 1.
I20260811 18:59:11.046128 20494 leader_election.cc:302] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9030c6ceef774f2eb5f15b59a4370f32, d9a2de91efe0467e962489193f51360f; no voters:
I20260811 18:59:11.046502 21194 raft_consensus.cc:2781] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:11.047035 21194 raft_consensus.cc:686] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 1 LEADER]: Becoming Leader. State: Replica: d9a2de91efe0467e962489193f51360f, State: Running, Role: LEADER
I20260811 18:59:11.047595 21194 consensus_queue.cc:237] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } }
I20260811 18:59:11.054749 20335 catalog_manager.cc:5495] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a2de91efe0467e962489193f51360f (127.19.155.193). New cstate: current_term: 1 leader_uuid: "d9a2de91efe0467e962489193f51360f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a2de91efe0467e962489193f51360f" member_type: VOTER last_known_addr { host: "127.19.155.193" port: 46341 } health_report { overall_health: HEALTHY } } }
I20260811 18:59:11.121793 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.116136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54076 (local address 127.19.155.193:46341)
0811 18:59:11.116376 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.116382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.116405 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:11.116539 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.116543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.116641 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.116807 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:11.117213 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.117924 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.119428 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.119977 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.120122 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.120657 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:11.121195 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:11.121379 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.121440 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.121524 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:59:11.130292 21068 raft_consensus.cc:1261] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 1 FOLLOWER]: Refusing update from remote peer d9a2de91efe0467e962489193f51360f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:11.130288 20854 raft_consensus.cc:1261] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 1 FOLLOWER]: Refusing update from remote peer d9a2de91efe0467e962489193f51360f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:11.131474 21203 consensus_queue.cc:1035] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9030c6ceef774f2eb5f15b59a4370f32" member_type: VOTER last_known_addr { host: "127.19.155.195" port: 40779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:11.131956 21194 consensus_queue.cc:1035] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9dc8d3bb138436f9e481078636e99e2" member_type: VOTER last_known_addr { host: "127.19.155.194" port: 33367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:11.143149 21208 mvcc.cc:205] Tried to move back new op lower bound from 7317400580619030528 to 7317400580295991296. Current Snapshot: MvccSnapshot[applied={T|T < 7317400580619030528}]
I20260811 18:59:11.144476 21210 mvcc.cc:205] Tried to move back new op lower bound from 7317400580619030528 to 7317400580295991296. Current Snapshot: MvccSnapshot[applied={T|T < 7317400580619030528}]
I20260811 18:59:11.151080 21212 mvcc.cc:205] Tried to move back new op lower bound from 7317400580619030528 to 7317400580295991296. Current Snapshot: MvccSnapshot[applied={T|T < 7317400580619030528}]
I20260811 18:59:11.160974 20333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:11.161383 20333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:59:11.167968 20333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f968f0ceb6944a91ae759031bca56254: Sending DeleteTablet for 3 replicas of tablet 78f3656803944228951b8905a6c360f1
I20260811 18:59:11.169440 21033 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f3656803944228951b8905a6c360f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:11 UTC) from {username='slave'} at 127.0.0.1:58028
I20260811 18:59:11.170173 20822 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f3656803944228951b8905a6c360f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:11 UTC) from {username='slave'} at 127.0.0.1:44480
I20260811 18:59:11.170418 20589 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f3656803944228951b8905a6c360f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:11 UTC) from {username='slave'} at 127.0.0.1:54066
I20260811 18:59:11.169523 21032 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f3656803944228951b8905a6c360f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:59:11 UTC) from {username='slave'} at 127.0.0.1:58028
I20260811 18:59:11.174559 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20464
I20260811 18:59:11.179574 21229 tablet_replica.cc:330] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: stopping tablet replica
I20260811 18:59:11.181383 21229 raft_consensus.cc:2229] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:59:11.181483 21228 tablet_replica.cc:330] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: stopping tablet replica
I20260811 18:59:11.181990 21228 raft_consensus.cc:2229] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:11.182616 21228 raft_consensus.cc:2258] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:11.182811 21226 tablet_replica.cc:330] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: stopping tablet replica
I20260811 18:59:11.183270 21226 raft_consensus.cc:2229] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:59:11.183789 21226 raft_consensus.cc:2258] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:11.183633 21229 raft_consensus.cc:2258] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:59:11.185441 21228 ts_tablet_manager.cc:1905] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:11.186870 21229 ts_tablet_manager.cc:1905] T 78f3656803944228951b8905a6c360f1 P d9a2de91efe0467e962489193f51360f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:11.189730 21183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.176691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.19.155.193:46341)
0811 18:59:11.176964 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.176979 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.180437 (+ 3458us) server_negotiation.cc:407] Connection header received
0811 18:59:11.180915 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.180924 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.181058 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.181182 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:11.182145 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.183468 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.185385 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.186043 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.186156 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.187828 (+ 1672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:11.187843 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:11.187869 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:11.188698 (+ 829us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:11.188776 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:11.188806 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:11.188911 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.189173 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.189299 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 18:59:11.190927 20693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:11.195118 21228 ts_tablet_manager.cc:1918] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:11.195344 21228 log.cc:1196] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-1/wal/wals/78f3656803944228951b8905a6c360f1
I20260811 18:59:11.195968 21228 ts_tablet_manager.cc:1939] T 78f3656803944228951b8905a6c360f1 P c9dc8d3bb138436f9e481078636e99e2: Deleting consensus metadata
I20260811 18:59:11.196480 21226 ts_tablet_manager.cc:1905] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:59:11.198187 20310 catalog_manager.cc:4841] TS c9dc8d3bb138436f9e481078636e99e2 (127.19.155.194:33367): tablet 78f3656803944228951b8905a6c360f1 (table test-table [id=468f720829374d488c5bdbd0a0983273]) successfully deleted
I20260811 18:59:11.201938 21226 ts_tablet_manager.cc:1918] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:59:11.202149 21226 log.cc:1196] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Deleting WAL directory at /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474422014372-20079-0/minicluster-data/ts-2/wal/wals/78f3656803944228951b8905a6c360f1
I20260811 18:59:11.202606 21226 ts_tablet_manager.cc:1939] T 78f3656803944228951b8905a6c360f1 P 9030c6ceef774f2eb5f15b59a4370f32: Deleting consensus metadata
I20260811 18:59:11.204443 20306 catalog_manager.cc:4841] TS 9030c6ceef774f2eb5f15b59a4370f32 (127.19.155.195:40779): tablet 78f3656803944228951b8905a6c360f1 (table test-table [id=468f720829374d488c5bdbd0a0983273]) successfully deleted
W20260811 18:59:11.204964 20306 catalog_manager.cc:4808] TS 9030c6ceef774f2eb5f15b59a4370f32 (127.19.155.195:40779): delete failed for tablet 78f3656803944228951b8905a6c360f1 because the tablet was not found. No further retry: Not found: Tablet not found: 78f3656803944228951b8905a6c360f1
I20260811 18:59:11.292750 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20464
W20260811 18:59:11.316957 20309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.155.193:46341 (error 108)
I20260811 18:59:11.317214 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20706
I20260811 18:59:11.318998 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.318445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54096)
0811 18:59:11.318614 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.318767 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 18:59:11.319285 20309 catalog_manager.cc:4584] TS d9a2de91efe0467e962489193f51360f (127.19.155.193:46341): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78f3656803944228951b8905a6c360f1: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
I20260811 18:59:11.324505 21179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.318113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44496 (local address 127.19.155.194:33367)
0811 18:59:11.318303 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.318311 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.318334 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:11.318414 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.318419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.318559 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.318677 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:11.319242 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.320156 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.321403 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.321809 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.321906 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.323145 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:11.323156 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:11.323172 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:11.323787 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:11.323837 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:11.323864 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:11.323957 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.324117 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.324215 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 18:59:11.325350 20920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:11.372989 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.372384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54106)
0811 18:59:11.372651 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.372788 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 18:59:11.374271 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.373807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54110)
0811 18:59:11.373981 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.374076 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 18:59:11.418771 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20706
I20260811 18:59:11.435105 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.434424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54118)
0811 18:59:11.434689 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.434791 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 18:59:11.436192 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.435832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54130)
0811 18:59:11.435989 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.436072 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:59:11.449834 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20931
I20260811 18:59:11.457163 21181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.450766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.19.155.195:40779)
0811 18:59:11.451003 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:11.451009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:11.451035 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:59:11.451107 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:11.451117 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:11.451210 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:11.451335 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:11.451785 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.452540 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.453901 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:11.454305 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:11.454446 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:11.455667 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:11.455678 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:11.455704 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:11.456329 (+ 625us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:11.456382 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:11.456403 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:11.456550 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:11.456785 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 18:59:11.456900 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 18:59:11.457981 21149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:11.517431 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.516748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54134)
0811 18:59:11.517034 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.517212 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 18:59:11.518770 21182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:11.518262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.193:46341 (local address 127.0.0.1:54150)
0811 18:59:11.518507 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:11.518603 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.193:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 18:59:11.551898 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20931
I20260811 18:59:11.584375 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 20278
I20260811 18:59:11.585533 20411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:11.699957 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 20278
2026-08-11T18:59:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3166 ms)
[----------] 6 tests from EncryptionPolicyTest (25084 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:11 dist-test-slave-1nl6 krb5kdc[21247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:11 dist-test-slave-1nl6 krb5kdc[21247](info): set up 2 sockets
Aug 11 18:59:11 dist-test-slave-1nl6 krb5kdc[21247](info): commencing operation
krb5kdc: starting...
W20260811 18:59:13.115739 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.357s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:13 dist-test-slave-1nl6 krb5kdc[21247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:13.468879 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:13.840291 21281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:13.840632 21281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:13.840838 21281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:13.849241 21281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:13.849388 21281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:13.849499 21281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:13.849606 21281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:13.849690 21281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:13.860481 21281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33523
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:13.861977 21281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:13.863492 21281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:13.876641 21290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:13.876667 21289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:13.877202 21296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:13.877597 21281 server_base.cc:1034] running on GCE node
I20260811 18:59:13.878491 21281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:13.880182 21281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:13.881403 21281 hybrid_clock.cc:648] HybridClock initialized: now 1786474753881337 us; error 59 us; skew 500 ppm
I20260811 18:59:13.881803 21281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:13 dist-test-slave-1nl6 krb5kdc[21247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474753, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:13.885456 21281 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:13.887245 21281 webserver.cc:460] Webserver started at http://127.0.0.1:44145/ using document root <none> and password file <none>
I20260811 18:59:13.887960 21281 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:13.888077 21281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:13.888370 21281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:13.891769 21281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "5b7f443816b4493d9ffe068d5c280d2e"
format_stamp: "Formatted at 2026-08-11 18:59:13 on dist-test-slave-1nl6"
server_key: "afa16619a3f99d76b040fcb087b09b52"
server_key_iv: "9c048e315fce9f289c69f70ae4378f45"
server_key_version: "encryptionkey@0"
I20260811 18:59:13.892611 21281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "5b7f443816b4493d9ffe068d5c280d2e"
format_stamp: "Formatted at 2026-08-11 18:59:13 on dist-test-slave-1nl6"
server_key: "afa16619a3f99d76b040fcb087b09b52"
server_key_iv: "9c048e315fce9f289c69f70ae4378f45"
server_key_version: "encryptionkey@0"
I20260811 18:59:13.898447 21281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:59:13.902657 21308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:13.904376 21281 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:59:13.904608 21281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "5b7f443816b4493d9ffe068d5c280d2e"
format_stamp: "Formatted at 2026-08-11 18:59:13 on dist-test-slave-1nl6"
server_key: "afa16619a3f99d76b040fcb087b09b52"
server_key_iv: "9c048e315fce9f289c69f70ae4378f45"
server_key_version: "encryptionkey@0"
I20260811 18:59:13.904860 21281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:13.932956 21281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:13.938076 21281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:13.938431 21281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:13.958954 21281 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33523
I20260811 18:59:13.959049 21395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33523 every 8 connection(s)
I20260811 18:59:13.960556 21281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:13.964970 21396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:13.965415 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21281
I20260811 18:59:13.965638 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:13.966315 20079 external_mini_cluster.cc:1428] Setting key 858b4c3389d3b75c9a6ad69aad9ab178
I20260811 18:59:13.981269 21396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e: Bootstrap starting.
Aug 11 18:59:13 dist-test-slave-1nl6 krb5kdc[21247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:59:13.985548 21396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:13.986836 21396 log.cc:824] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:13.990271 21396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e: No bootstrap required, opened a new log
I20260811 18:59:13.993593 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:13.968479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57371 (local address 127.0.0.1:33523)
0811 18:59:13.969369 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:13.969385 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:13.969436 (+ 51us) server_negotiation.cc:407] Connection header received
0811 18:59:13.971793 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:13.971828 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:13.972370 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:13.972780 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:13.974893 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:13.976601 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:13.978679 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:13.979593 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:13.979760 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:13.985130 (+ 5370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:13.985141 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:13.985160 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:13.985215 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:13.988706 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:13.989772 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:13.989780 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:13.989787 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:13.989974 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:13.990483 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:13.990488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:13.990496 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:13.991140 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:13.991510 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:13.992080 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 18:59:13.992474 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":406,"threads_started":1}
I20260811 18:59:13.998180 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:13.999747 21396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260811 18:59:14.000228 21396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:14.000357 21396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7f443816b4493d9ffe068d5c280d2e, State: Initialized, Role: FOLLOWER
I20260811 18:59:14.001062 21396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260811 18:59:14.001348 21396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:14.001538 21396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:14.001752 21396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:14.005975 21396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260811 18:59:14.006850 21396 leader_election.cc:302] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b7f443816b4493d9ffe068d5c280d2e; no voters:
I20260811 18:59:14.007823 21396 leader_election.cc:288] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:14.007947 21412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:14.011255 21396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:14.015830 21412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [term 1 LEADER]: Becoming Leader. State: Replica: 5b7f443816b4493d9ffe068d5c280d2e, State: Running, Role: LEADER
I20260811 18:59:14.016831 21412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } }
I20260811 18:59:14.027726 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:14.003717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42085 (local address 127.0.0.1:33523)
0811 18:59:14.004046 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:14.004054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:14.004825 (+ 771us) server_negotiation.cc:407] Connection header received
0811 18:59:14.005077 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:14.005085 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:14.005180 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:14.005295 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:14.008018 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:14.009321 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:14.011667 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:14.012474 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:14.012622 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:14.017660 (+ 5038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:14.017668 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:14.017674 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:14.017727 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:14.022312 (+ 4585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:14.023609 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:14.023616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:14.023622 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:14.023968 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:14.024692 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:14.024698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:14.024701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:14.025243 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:14.025617 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:14.027042 (+ 1425us) server_negotiation.cc:299] Negotiation successful
0811 18:59:14.027270 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:59:14.028419 21414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b7f443816b4493d9ffe068d5c280d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } } }
I20260811 18:59:14.029076 21413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b7f443816b4493d9ffe068d5c280d2e. Latest consensus state: current_term: 1 leader_uuid: "5b7f443816b4493d9ffe068d5c280d2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7f443816b4493d9ffe068d5c280d2e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33523 } } }
I20260811 18:59:14.029469 21413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:14.031857 21414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:14.033179 21432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:14.042568 21432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:14.051312 21445 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:59:14.058053 21432 catalog_manager.cc:1347] Generated new cluster ID: 5ba3710dda5b4e3092c85a267d7fbd80
I20260811 18:59:14.058219 21432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:14.083873 21432 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:14.085311 21432 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:14.093053 21432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b7f443816b4493d9ffe068d5c280d2e: Generated new TSK 0
I20260811 18:59:14.094033 21432 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:14.108808 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21281
I20260811 18:59:14.110976 21387 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:14.210366 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21281
W20260811 18:59:14.237859 21244 connection.cc:535] client connection to 127.0.0.1:33523 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33523): Connection reset by peer (error 104)
2026-08-11T18:59:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:14 dist-test-slave-1nl6 krb5kdc[21453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:14 dist-test-slave-1nl6 krb5kdc[21453](info): set up 2 sockets
Aug 11 18:59:14 dist-test-slave-1nl6 krb5kdc[21453](info): commencing operation
krb5kdc: starting...
W20260811 18:59:15.591998 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:15 dist-test-slave-1nl6 krb5kdc[21453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:15.952605 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:16.330484 21482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:16.330816 21482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:16.331020 21482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:16.338753 21482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:16.338876 21482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:16.338985 21482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:16.339089 21482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:16.339156 21482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:16.349327 21482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45197
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:16.350713 21482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:16.352164 21482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:16.364766 21494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:16.364845 21489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:16.364826 21488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:16.365748 21482 server_base.cc:1034] running on GCE node
I20260811 18:59:16.366611 21482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:16.368300 21482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:16.369536 21482 hybrid_clock.cc:648] HybridClock initialized: now 1786474756369495 us; error 37 us; skew 500 ppm
I20260811 18:59:16.369927 21482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:16 dist-test-slave-1nl6 krb5kdc[21453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474756, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:16.376763 21482 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:16.378497 21482 webserver.cc:460] Webserver started at http://127.0.0.1:34633/ using document root <none> and password file <none>
I20260811 18:59:16.379276 21482 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:16.379392 21482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:16.379675 21482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:16.382830 21482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f"
format_stamp: "Formatted at 2026-08-11 18:59:16 on dist-test-slave-1nl6"
server_key: "587cfcffd65fd9f1931466a10e28bc1e"
server_key_iv: "c97a16bf2ac49b3c8edcedc028f204e9"
server_key_version: "encryptionkey@0"
I20260811 18:59:16.383731 21482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f"
format_stamp: "Formatted at 2026-08-11 18:59:16 on dist-test-slave-1nl6"
server_key: "587cfcffd65fd9f1931466a10e28bc1e"
server_key_iv: "c97a16bf2ac49b3c8edcedc028f204e9"
server_key_version: "encryptionkey@0"
I20260811 18:59:16.389365 21482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 18:59:16.393167 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:16.394651 21482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:59:16.394953 21482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f"
format_stamp: "Formatted at 2026-08-11 18:59:16 on dist-test-slave-1nl6"
server_key: "587cfcffd65fd9f1931466a10e28bc1e"
server_key_iv: "c97a16bf2ac49b3c8edcedc028f204e9"
server_key_version: "encryptionkey@0"
I20260811 18:59:16.395200 21482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:16.417666 21482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:16.422072 21482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:16.422403 21482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:16.442620 21482 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45197
I20260811 18:59:16.442655 21595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45197 every 8 connection(s)
I20260811 18:59:16.444152 21482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:16.448149 21599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:16.449345 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21482
I20260811 18:59:16.449543 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:16.450184 20079 external_mini_cluster.cc:1428] Setting key 7256d6d5fc75f3dbb93e4c8b24029634
I20260811 18:59:16.462630 21599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f: Bootstrap starting.
I20260811 18:59:16.464226 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:16.452220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51401 (local address 127.0.0.1:45197)
0811 18:59:16.453069 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:16.453083 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:16.453127 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:59:16.454762 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:16.454791 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:16.455284 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:16.455616 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:16.456238 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:16.457592 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:16.459641 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:16.460338 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:16.460475 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:16.461811 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:16.461819 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:16.461833 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:16.462389 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:16.462468 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:16.462493 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:16.462621 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:16.463047 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 18:59:16.463251 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":394,"threads_started":1}
I20260811 18:59:16.466038 21599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:16.467366 21599 log.cc:824] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:16.468240 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:16.470351 21599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f: No bootstrap required, opened a new log
I20260811 18:59:16.480007 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:16.473029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44487 (local address 127.0.0.1:45197)
0811 18:59:16.473189 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:16.473194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:16.473552 (+ 358us) server_negotiation.cc:407] Connection header received
0811 18:59:16.473743 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:16.473747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:16.473808 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:16.473890 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:16.474554 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:16.475379 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:16.477302 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:16.477756 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:16.477853 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:16.479168 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:16.479173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:16.479177 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:16.479195 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:16.479265 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:16.479281 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:16.479370 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:16.479593 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 18:59:16.479642 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:59:16.480613 21599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } }
I20260811 18:59:16.481034 21599 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:16.481166 21599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb7fe1ad23498ea8e90e5cf2fa708f, State: Initialized, Role: FOLLOWER
I20260811 18:59:16.481770 21599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } }
I20260811 18:59:16.482021 21599 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:16.482182 21599 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:16.482359 21599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:16.484760 21599 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } }
I20260811 18:59:16.485308 21599 leader_election.cc:302] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cdb7fe1ad23498ea8e90e5cf2fa708f; no voters:
I20260811 18:59:16.486061 21599 leader_election.cc:288] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:16.486182 21617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:16.487000 21617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [term 1 LEADER]: Becoming Leader. State: Replica: 6cdb7fe1ad23498ea8e90e5cf2fa708f, State: Running, Role: LEADER
I20260811 18:59:16.487682 21617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } }
I20260811 18:59:16.488632 21599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:16.491008 21619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } } }
I20260811 18:59:16.491066 21622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cdb7fe1ad23498ea8e90e5cf2fa708f. Latest consensus state: current_term: 1 leader_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cdb7fe1ad23498ea8e90e5cf2fa708f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45197 } } }
I20260811 18:59:16.491473 21619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:16.491495 21622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:16.494000 21626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:16.500013 21626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:16.511511 21626 catalog_manager.cc:1347] Generated new cluster ID: 4597a9bd236640399427d89d73661766
I20260811 18:59:16.512085 21626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:16.561177 21626 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:16.563232 21626 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:16.575271 21626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cdb7fe1ad23498ea8e90e5cf2fa708f: Generated new TSK 0
I20260811 18:59:16.576485 21626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:16.583479 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21482
W20260811 18:59:16.584789 21591 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51401
W20260811 18:59:16.585629 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21482: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:16.585835 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21482
W20260811 18:59:16.611754 21449 connection.cc:535] client connection to 127.0.0.1:45197 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45197): Connection reset by peer (error 104)
2026-08-11T18:59:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2373 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:16 dist-test-slave-1nl6 krb5kdc[21654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:16 dist-test-slave-1nl6 krb5kdc[21654](info): set up 2 sockets
Aug 11 18:59:16 dist-test-slave-1nl6 krb5kdc[21654](info): commencing operation
krb5kdc: starting...
W20260811 18:59:17.963033 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:18 dist-test-slave-1nl6 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:18.318737 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41461
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:18.681106 21676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:18.681461 21676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:18.681565 21676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:18.689062 21676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:18.689200 21676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:18.689249 21676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:18.689328 21676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:18.689374 21676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:18.699715 21676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41461
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:18.701097 21676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:18.702615 21676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:18.715978 21697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:18.715950 21700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:18.716030 21695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:18.716907 21676 server_base.cc:1034] running on GCE node
I20260811 18:59:18.717892 21676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:18.719585 21676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:18.720857 21676 hybrid_clock.cc:648] HybridClock initialized: now 1786474758720807 us; error 64 us; skew 500 ppm
I20260811 18:59:18.721268 21676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:18 dist-test-slave-1nl6 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474758, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:18.724895 21676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:18.726675 21676 webserver.cc:460] Webserver started at http://127.0.0.1:40059/ using document root <none> and password file <none>
I20260811 18:59:18.727509 21676 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:18.727675 21676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:18.728032 21676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:18.731436 21676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "2e63001034dd4470bef8cf8aaa4c9f48"
format_stamp: "Formatted at 2026-08-11 18:59:18 on dist-test-slave-1nl6"
server_key: "7b109d3f79e2eda856680f457000c332"
server_key_iv: "b1fc9a4f40b3c567ad8a12b275485da3"
server_key_version: "encryptionkey@0"
I20260811 18:59:18.732339 21676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "2e63001034dd4470bef8cf8aaa4c9f48"
format_stamp: "Formatted at 2026-08-11 18:59:18 on dist-test-slave-1nl6"
server_key: "7b109d3f79e2eda856680f457000c332"
server_key_iv: "b1fc9a4f40b3c567ad8a12b275485da3"
server_key_version: "encryptionkey@0"
I20260811 18:59:18.738255 21676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 18:59:18.742455 21715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:18.744046 21676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:18.744267 21676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "2e63001034dd4470bef8cf8aaa4c9f48"
format_stamp: "Formatted at 2026-08-11 18:59:18 on dist-test-slave-1nl6"
server_key: "7b109d3f79e2eda856680f457000c332"
server_key_iv: "b1fc9a4f40b3c567ad8a12b275485da3"
server_key_version: "encryptionkey@0"
I20260811 18:59:18.744514 21676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:18.751089 21676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:18.755731 21676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:18.756095 21676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:18.776530 21676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41461
I20260811 18:59:18.776588 21804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41461 every 8 connection(s)
I20260811 18:59:18.778131 21676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:18.782383 21807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:18.784075 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21676
I20260811 18:59:18.784286 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:18.784747 20079 external_mini_cluster.cc:1428] Setting key 513ab71553c8c7827c42256f5a2ae918
I20260811 18:59:18.794010 21816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:18.786862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33847 (local address 127.0.0.1:41461)
0811 18:59:18.787845 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:18.787863 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:18.787922 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:59:18.789792 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:18.789828 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:18.790346 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:18.790851 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:18.791980 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:18.791989 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:18.792007 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:18.792026 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:18.792103 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:18.792157 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:18.792391 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:18.792516 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 18:59:18.792741 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":387,"threads_started":1}
I20260811 18:59:18.798034 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:18.798048 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48: Bootstrap starting.
I20260811 18:59:18.801353 21807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:18.802707 21807 log.cc:824] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:18.805364 21816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:18.802566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40317 (local address 127.0.0.1:41461)
0811 18:59:18.802732 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:18.802736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:18.803259 (+ 523us) server_negotiation.cc:407] Connection header received
0811 18:59:18.803482 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:18.803486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:18.803537 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:18.803653 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:18.804697 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:18.804703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:18.804708 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:18.804733 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:18.804774 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:18.804789 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:18.804913 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:18.805015 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 18:59:18.805077 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:59:18.806207 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48: No bootstrap required, opened a new log
I20260811 18:59:18.814209 21807 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260811 18:59:18.814592 21807 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:18.814693 21807 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e63001034dd4470bef8cf8aaa4c9f48, State: Initialized, Role: FOLLOWER
I20260811 18:59:18.815390 21807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260811 18:59:18.815655 21807 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:18.815825 21807 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:18.816000 21807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:18.818661 21807 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260811 18:59:18.819285 21807 leader_election.cc:302] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e63001034dd4470bef8cf8aaa4c9f48; no voters:
I20260811 18:59:18.819944 21807 leader_election.cc:288] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:18.820079 21827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:18.820907 21827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [term 1 LEADER]: Becoming Leader. State: Replica: 2e63001034dd4470bef8cf8aaa4c9f48, State: Running, Role: LEADER
I20260811 18:59:18.821499 21827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } }
I20260811 18:59:18.822317 21807 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:18.824522 21828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } } }
I20260811 18:59:18.824994 21828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:18.824534 21830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e63001034dd4470bef8cf8aaa4c9f48. Latest consensus state: current_term: 1 leader_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e63001034dd4470bef8cf8aaa4c9f48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41461 } } }
I20260811 18:59:18.827348 21830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:18.828826 21837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:18.839131 21837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:18.849421 21837 catalog_manager.cc:1347] Generated new cluster ID: 7463d1b6fc8b4390b0eca7f2ee16a62d
I20260811 18:59:18.849566 21837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:18.883649 21837 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:18.884186 21837 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:18.894455 21837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e63001034dd4470bef8cf8aaa4c9f48: Generated new TSK 0
I20260811 18:59:18.895483 21837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:18.909535 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21676
W20260811 18:59:18.910779 21790 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33847
W20260811 18:59:18.911576 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21676: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:18.911749 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21676
2026-08-11T18:59:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2327 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:19 dist-test-slave-1nl6 krb5kdc[21864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:19 dist-test-slave-1nl6 krb5kdc[21864](info): set up 2 sockets
Aug 11 18:59:19 dist-test-slave-1nl6 krb5kdc[21864](info): commencing operation
krb5kdc: starting...
W20260811 18:59:20.309639 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.350s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:20 dist-test-slave-1nl6 krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:20.669531 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46747
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:21.034618 21883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:21.035029 21883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:21.035208 21883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:21.042745 21883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:21.042878 21883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:21.043002 21883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:21.043116 21883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:21.043207 21883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:21.053756 21883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:21.055301 21883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:21.056676 21883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:21.069108 21892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:21.069437 21893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:21.069749 21898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:21.070302 21883 server_base.cc:1034] running on GCE node
I20260811 18:59:21.071144 21883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:21.072575 21883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:21.073820 21883 hybrid_clock.cc:648] HybridClock initialized: now 1786474761073773 us; error 38 us; skew 500 ppm
I20260811 18:59:21.074208 21883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:21 dist-test-slave-1nl6 krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474761, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:21.077451 21883 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:21.079038 21883 webserver.cc:460] Webserver started at http://127.0.0.1:42247/ using document root <none> and password file <none>
I20260811 18:59:21.080034 21883 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:21.080189 21883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:21.080617 21883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:21.085517 21883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "8ff57373896f47968e2bc921ce230bef"
format_stamp: "Formatted at 2026-08-11 18:59:21 on dist-test-slave-1nl6"
server_key: "09ecfab98f969a3a4edf732480b3b88f"
server_key_iv: "f4e178f5d9e4c133748a1cb569d06bc0"
server_key_version: "encryptionkey@0"
I20260811 18:59:21.086722 21883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "8ff57373896f47968e2bc921ce230bef"
format_stamp: "Formatted at 2026-08-11 18:59:21 on dist-test-slave-1nl6"
server_key: "09ecfab98f969a3a4edf732480b3b88f"
server_key_iv: "f4e178f5d9e4c133748a1cb569d06bc0"
server_key_version: "encryptionkey@0"
I20260811 18:59:21.093829 21883 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:59:21.097573 21915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:21.099090 21883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:21.099295 21883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "8ff57373896f47968e2bc921ce230bef"
format_stamp: "Formatted at 2026-08-11 18:59:21 on dist-test-slave-1nl6"
server_key: "09ecfab98f969a3a4edf732480b3b88f"
server_key_iv: "f4e178f5d9e4c133748a1cb569d06bc0"
server_key_version: "encryptionkey@0"
I20260811 18:59:21.099514 21883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:21.116710 21883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:21.121007 21883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:21.121321 21883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:21.141152 21883 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46747
I20260811 18:59:21.141192 22019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46747 every 8 connection(s)
I20260811 18:59:21.142664 21883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:21.145642 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 21883
I20260811 18:59:21.145855 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:21.146416 20079 external_mini_cluster.cc:1428] Setting key 23c6d093a5bcb01064f5590eaa9992a5
I20260811 18:59:21.147310 22020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:59:21 dist-test-slave-1nl6 krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:59:21.162796 22020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef: Bootstrap starting.
I20260811 18:59:21.166513 22020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:21.168087 22020 log.cc:824] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:21.171384 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:21.148297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46215 (local address 127.0.0.1:46747)
0811 18:59:21.149093 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:21.149105 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:21.149146 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:59:21.150730 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:21.150750 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:21.151245 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:21.151588 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:21.153502 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:21.154889 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:21.156778 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:21.157498 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:21.157651 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:21.162887 (+ 5236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:21.162946 (+ 59us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:21.162973 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:21.163029 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:21.166143 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:21.167105 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:21.167118 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:21.167129 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:21.167363 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:21.167898 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:21.167904 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:21.167907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:21.168654 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:21.169038 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:21.169733 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 18:59:21.170206 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":361,"threads_started":1}
I20260811 18:59:21.171695 22020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef: No bootstrap required, opened a new log
I20260811 18:59:21.175638 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:21.180586 22020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } }
I20260811 18:59:21.181003 22020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:21.181126 22020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff57373896f47968e2bc921ce230bef, State: Initialized, Role: FOLLOWER
I20260811 18:59:21.181844 22020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } }
I20260811 18:59:21.182096 22020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:21.182256 22020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:21.182441 22020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:21.185415 22020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } }
I20260811 18:59:21.186041 22020 leader_election.cc:302] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ff57373896f47968e2bc921ce230bef; no voters:
I20260811 18:59:21.186781 22020 leader_election.cc:288] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:21.186954 22037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:21.188983 22020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:21.190769 22037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [term 1 LEADER]: Becoming Leader. State: Replica: 8ff57373896f47968e2bc921ce230bef, State: Running, Role: LEADER
I20260811 18:59:21.191596 22037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } }
I20260811 18:59:21.198945 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:21.180265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50497 (local address 127.0.0.1:46747)
0811 18:59:21.180529 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:21.180539 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:21.181096 (+ 557us) server_negotiation.cc:407] Connection header received
0811 18:59:21.181379 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:21.181384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:21.181474 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:21.181592 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:21.183394 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:21.184549 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:21.185817 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:21.186573 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:21.186729 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:21.190563 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:21.190574 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:21.190583 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:21.190642 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:21.195597 (+ 4955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:21.196373 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:21.196382 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:21.196389 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:21.196633 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:21.197039 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:21.197047 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:21.197053 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:21.197576 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:21.197926 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:21.198098 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 18:59:21.198413 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 18:59:21.200109 22039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ff57373896f47968e2bc921ce230bef. Latest consensus state: current_term: 1 leader_uuid: "8ff57373896f47968e2bc921ce230bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } } }
I20260811 18:59:21.200492 22039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:21.201501 22066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:21.201628 22038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ff57373896f47968e2bc921ce230bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ff57373896f47968e2bc921ce230bef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46747 } } }
I20260811 18:59:21.201974 22038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:21.207088 22066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:21.216277 22066 catalog_manager.cc:1347] Generated new cluster ID: 0b6543de568a44b4bc53eacf1a8e0f6c
I20260811 18:59:21.216472 22066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:21.244659 22066 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:21.246366 22066 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:21.259409 22066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ff57373896f47968e2bc921ce230bef: Generated new TSK 0
I20260811 18:59:21.260553 22066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:21.271826 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 21883
I20260811 18:59:21.273204 22010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:21.368280 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 21883
2026-08-11T18:59:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:21 dist-test-slave-1nl6 krb5kdc[22083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:21 dist-test-slave-1nl6 krb5kdc[22083](info): set up 2 sockets
Aug 11 18:59:21 dist-test-slave-1nl6 krb5kdc[22083](info): commencing operation
krb5kdc: starting...
W20260811 18:59:22.764387 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:22 dist-test-slave-1nl6 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:23.118070 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45931
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:23.483134 22109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:23.483476 22109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:23.483577 22109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:23.491097 22109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:23.491245 22109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:23.491295 22109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:23.491369 22109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:23.491415 22109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:23.501696 22109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:23.503114 22109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:23.504513 22109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:23.517423 22118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:23.517400 22122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:23.517472 22119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:23.519011 22109 server_base.cc:1034] running on GCE node
I20260811 18:59:23.519881 22109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:23.521440 22109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:23.522661 22109 hybrid_clock.cc:648] HybridClock initialized: now 1786474763522618 us; error 41 us; skew 500 ppm
I20260811 18:59:23.523124 22109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:23 dist-test-slave-1nl6 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474763, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:23.526540 22109 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:23.528424 22109 webserver.cc:460] Webserver started at http://127.0.0.1:35077/ using document root <none> and password file <none>
I20260811 18:59:23.529209 22109 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:23.529393 22109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:23.529740 22109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:23.533164 22109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "fb7bf7be9bea4adbbad6a1775d117203"
format_stamp: "Formatted at 2026-08-11 18:59:23 on dist-test-slave-1nl6"
server_key: "3807edd007f6e6cfdc0b2a1e9ae2e455"
server_key_iv: "47f46ad377fdb16600824a12ed7bf80c"
server_key_version: "encryptionkey@0"
I20260811 18:59:23.534076 22109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "fb7bf7be9bea4adbbad6a1775d117203"
format_stamp: "Formatted at 2026-08-11 18:59:23 on dist-test-slave-1nl6"
server_key: "3807edd007f6e6cfdc0b2a1e9ae2e455"
server_key_iv: "47f46ad377fdb16600824a12ed7bf80c"
server_key_version: "encryptionkey@0"
I20260811 18:59:23.540128 22109 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:59:23.544416 22133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:23.545964 22109 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260811 18:59:23.546211 22109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "fb7bf7be9bea4adbbad6a1775d117203"
format_stamp: "Formatted at 2026-08-11 18:59:23 on dist-test-slave-1nl6"
server_key: "3807edd007f6e6cfdc0b2a1e9ae2e455"
server_key_iv: "47f46ad377fdb16600824a12ed7bf80c"
server_key_version: "encryptionkey@0"
I20260811 18:59:23.546455 22109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:23.579073 22109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:23.584076 22109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:23.584427 22109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:23.605279 22109 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45931
I20260811 18:59:23.605305 22228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45931 every 8 connection(s)
I20260811 18:59:23.606869 22109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:23.611179 22229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:23.615329 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22109
I20260811 18:59:23.615547 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:23.616132 20079 external_mini_cluster.cc:1428] Setting key 122dc7fa2ddccce5f6210034b0c8ce7f
I20260811 18:59:23.624814 22229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203: Bootstrap starting.
I20260811 18:59:23.628561 22229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:23.630091 22229 log.cc:824] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:23.630364 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:23.618209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51617 (local address 127.0.0.1:45931)
0811 18:59:23.619121 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:23.619135 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:23.619183 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:59:23.621003 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:23.621033 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:23.621520 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:23.621975 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:23.622628 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:23.624042 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:23.625543 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:23.626278 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:23.626506 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:23.627822 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:23.627830 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:23.627848 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:23.628434 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:23.628550 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:23.628578 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:23.628728 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:23.629001 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:59:23.629309 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":361,"threads_started":1}
I20260811 18:59:23.633558 22229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203: No bootstrap required, opened a new log
I20260811 18:59:23.634452 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:23.642781 22229 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } }
I20260811 18:59:23.643375 22229 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:23.643497 22229 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7bf7be9bea4adbbad6a1775d117203, State: Initialized, Role: FOLLOWER
I20260811 18:59:23.644205 22229 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } }
I20260811 18:59:23.644517 22229 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:23.644680 22229 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:23.644901 22229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:23.645910 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:23.638972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60015 (local address 127.0.0.1:45931)
0811 18:59:23.639186 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:23.639193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:23.639471 (+ 278us) server_negotiation.cc:407] Connection header received
0811 18:59:23.639649 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:23.639655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:23.639744 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:23.639876 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:23.640366 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:23.641566 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:23.642952 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:23.643650 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:23.643792 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:23.645063 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:23.645073 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:23.645081 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:23.645108 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:23.645159 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:23.645184 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:23.645295 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:23.645437 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 18:59:23.645539 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 18:59:23.648072 22229 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } }
I20260811 18:59:23.648588 22229 leader_election.cc:302] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb7bf7be9bea4adbbad6a1775d117203; no voters:
I20260811 18:59:23.649202 22229 leader_election.cc:288] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:23.649343 22245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:23.650810 22245 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [term 1 LEADER]: Becoming Leader. State: Replica: fb7bf7be9bea4adbbad6a1775d117203, State: Running, Role: LEADER
I20260811 18:59:23.651541 22245 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } }
I20260811 18:59:23.651858 22229 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:23.654241 22249 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb7bf7be9bea4adbbad6a1775d117203. Latest consensus state: current_term: 1 leader_uuid: "fb7bf7be9bea4adbbad6a1775d117203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } } }
I20260811 18:59:23.654369 22248 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb7bf7be9bea4adbbad6a1775d117203" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb7bf7be9bea4adbbad6a1775d117203" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45931 } } }
I20260811 18:59:23.654681 22249 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:23.654826 22248 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:23.655802 22254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:23.671460 22254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:23.682956 22254 catalog_manager.cc:1347] Generated new cluster ID: db6433366cbf4e56829a0d21410eef37
I20260811 18:59:23.683146 22254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:23.699834 22254 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:23.702265 22254 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:23.713565 22254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb7bf7be9bea4adbbad6a1775d117203: Generated new TSK 0
I20260811 18:59:23.714854 22254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:23.725713 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22109
W20260811 18:59:23.727082 22217 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51617
W20260811 18:59:23.727871 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22109: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:23.728046 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22109
2026-08-11T18:59:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2360 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:23 dist-test-slave-1nl6 krb5kdc[22281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:23 dist-test-slave-1nl6 krb5kdc[22281](info): set up 2 sockets
Aug 11 18:59:23 dist-test-slave-1nl6 krb5kdc[22281](info): commencing operation
krb5kdc: starting...
W20260811 18:59:25.125922 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:25 dist-test-slave-1nl6 krb5kdc[22281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:25.490048 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41565
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:25.854851 22297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:25.855301 22297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:25.855474 22297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:25.862974 22297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:25.863147 22297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:25.863262 22297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:25.863372 22297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:25.863451 22297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:25.873682 22297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:25.875550 22297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:25.877034 22297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:25.889855 22317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:25.889775 22320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:25.890147 22311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:25.891022 22297 server_base.cc:1034] running on GCE node
I20260811 18:59:25.891903 22297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:25.893460 22297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:25.894690 22297 hybrid_clock.cc:648] HybridClock initialized: now 1786474765894648 us; error 31 us; skew 500 ppm
I20260811 18:59:25.895138 22297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:25 dist-test-slave-1nl6 krb5kdc[22281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474765, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:25.898581 22297 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:25.900327 22297 webserver.cc:460] Webserver started at http://127.0.0.1:42083/ using document root <none> and password file <none>
I20260811 18:59:25.901060 22297 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:25.901226 22297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:25.901580 22297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:25.904886 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "20233b64b3054316a14ca6596dde5121"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-1nl6"
server_key: "c558d7489bd5ecf90575eb55892d57a4"
server_key_iv: "d4868f4f789cc232c3f232609af48a44"
server_key_version: "encryptionkey@0"
I20260811 18:59:25.905733 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "20233b64b3054316a14ca6596dde5121"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-1nl6"
server_key: "c558d7489bd5ecf90575eb55892d57a4"
server_key_iv: "d4868f4f789cc232c3f232609af48a44"
server_key_version: "encryptionkey@0"
I20260811 18:59:25.911396 22297 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 18:59:25.915174 22331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:25.916611 22297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:25.916822 22297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "20233b64b3054316a14ca6596dde5121"
format_stamp: "Formatted at 2026-08-11 18:59:25 on dist-test-slave-1nl6"
server_key: "c558d7489bd5ecf90575eb55892d57a4"
server_key_iv: "d4868f4f789cc232c3f232609af48a44"
server_key_version: "encryptionkey@0"
I20260811 18:59:25.917054 22297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:25.923432 22297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:25.928179 22297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:25.928506 22297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:25.993196 22297 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41565
I20260811 18:59:25.993283 22415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41565 every 8 connection(s)
I20260811 18:59:25.997112 22297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:26.006049 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22297
I20260811 18:59:26.008648 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:26.011682 20079 external_mini_cluster.cc:1428] Setting key ef72fd62b1ffc6d32f5fc17fa3077d8e
I20260811 18:59:26.013072 22416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:26.054833 22423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.023845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44355 (local address 127.0.0.1:41565)
0811 18:59:26.029269 (+ 5424us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.029438 (+ 169us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.029596 (+ 158us) server_negotiation.cc:407] Connection header received
0811 18:59:26.036790 (+ 7194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.036892 (+ 102us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.038713 (+ 1821us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.040096 (+ 1383us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:26.044548 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:26.044580 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:26.044797 (+ 217us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:26.045031 (+ 234us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:26.045810 (+ 779us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:26.045934 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:26.046886 (+ 952us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.047449 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.048342 (+ 893us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3598,"thread_start_us":2518,"threads_started":1}
I20260811 18:59:26.078872 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:26.082525 22416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121: Bootstrap starting.
I20260811 18:59:26.089737 22416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:26.091466 22423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:26.086827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41631 (local address 127.0.0.1:41565)
0811 18:59:26.087179 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:26.087197 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:26.087865 (+ 668us) server_negotiation.cc:407] Connection header received
0811 18:59:26.088155 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:26.088176 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:26.088313 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:26.088551 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:26.090061 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:26.090075 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:26.090092 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:26.090147 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:26.090273 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:26.090334 (+ 61us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:26.090653 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:26.090767 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 18:59:26.090921 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260811 18:59:26.092470 22416 log.cc:824] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:26.100157 22416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121: No bootstrap required, opened a new log
I20260811 18:59:26.122084 22416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } }
I20260811 18:59:26.123188 22416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:26.123420 22416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20233b64b3054316a14ca6596dde5121, State: Initialized, Role: FOLLOWER
I20260811 18:59:26.124853 22416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } }
I20260811 18:59:26.125326 22416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:26.125613 22416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:26.125988 22416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:26.130566 22416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } }
I20260811 18:59:26.131713 22416 leader_election.cc:302] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20233b64b3054316a14ca6596dde5121; no voters:
I20260811 18:59:26.132715 22416 leader_election.cc:288] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:26.133004 22436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:26.135324 22436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [term 1 LEADER]: Becoming Leader. State: Replica: 20233b64b3054316a14ca6596dde5121, State: Running, Role: LEADER
I20260811 18:59:26.136327 22436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } }
I20260811 18:59:26.137269 22416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:26.143402 22440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20233b64b3054316a14ca6596dde5121. Latest consensus state: current_term: 1 leader_uuid: "20233b64b3054316a14ca6596dde5121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } } }
I20260811 18:59:26.145123 22440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:26.145185 22439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20233b64b3054316a14ca6596dde5121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20233b64b3054316a14ca6596dde5121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41565 } } }
I20260811 18:59:26.146668 22439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:26.161484 22449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:26.173103 22449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:26.190860 22449 catalog_manager.cc:1347] Generated new cluster ID: 2028d8afaf4e45b5b181dd729ce5063c
I20260811 18:59:26.191118 22449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:26.233246 22449 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:26.234048 22449 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:26.257751 22449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20233b64b3054316a14ca6596dde5121: Generated new TSK 0
I20260811 18:59:26.259603 22449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:26.275058 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22297
W20260811 18:59:26.278812 22408 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44355
W20260811 18:59:26.280434 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22297: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:26.280756 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22297
2026-08-11T18:59:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:26 dist-test-slave-1nl6 krb5kdc[22473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:26 dist-test-slave-1nl6 krb5kdc[22473](info): set up 2 sockets
Aug 11 18:59:26 dist-test-slave-1nl6 krb5kdc[22473](info): commencing operation
krb5kdc: starting...
W20260811 18:59:27.697160 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:27 dist-test-slave-1nl6 krb5kdc[22473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:28.062158 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:28.445545 22499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:28.445894 22499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:28.445992 22499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:28.453619 22499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:28.453769 22499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:28.453826 22499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:28.453889 22499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:28.453936 22499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:28.464505 22499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:28.465919 22499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:28.467356 22499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:28.480285 22510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:28.480211 22511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:28.480232 22513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:28.481151 22499 server_base.cc:1034] running on GCE node
I20260811 18:59:28.482118 22499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:28.483795 22499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:28.485023 22499 hybrid_clock.cc:648] HybridClock initialized: now 1786474768484979 us; error 31 us; skew 500 ppm
I20260811 18:59:28.485622 22499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:28 dist-test-slave-1nl6 krb5kdc[22473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474768, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:28.494050 22499 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:28.495920 22499 webserver.cc:460] Webserver started at http://127.0.0.1:46541/ using document root <none> and password file <none>
I20260811 18:59:28.496713 22499 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:28.496872 22499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:28.497231 22499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:28.500653 22499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "f9868f66f045455bb8b7903cc6971494"
format_stamp: "Formatted at 2026-08-11 18:59:28 on dist-test-slave-1nl6"
server_key: "765b5a69e2d1b85481302e597496bf78"
server_key_iv: "1e55e18e50bb264d2dac2eb1ed02a601"
server_key_version: "encryptionkey@0"
I20260811 18:59:28.501535 22499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "f9868f66f045455bb8b7903cc6971494"
format_stamp: "Formatted at 2026-08-11 18:59:28 on dist-test-slave-1nl6"
server_key: "765b5a69e2d1b85481302e597496bf78"
server_key_iv: "1e55e18e50bb264d2dac2eb1ed02a601"
server_key_version: "encryptionkey@0"
I20260811 18:59:28.507437 22499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:59:28.511256 22529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:28.512681 22499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:28.512900 22499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "f9868f66f045455bb8b7903cc6971494"
format_stamp: "Formatted at 2026-08-11 18:59:28 on dist-test-slave-1nl6"
server_key: "765b5a69e2d1b85481302e597496bf78"
server_key_iv: "1e55e18e50bb264d2dac2eb1ed02a601"
server_key_version: "encryptionkey@0"
I20260811 18:59:28.513139 22499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:28.543715 22499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:28.548038 22499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:28.548368 22499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:28.568372 22499 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34469
I20260811 18:59:28.568408 22619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34469 every 8 connection(s)
I20260811 18:59:28.569952 22499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:28.571161 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22499
I20260811 18:59:28.571394 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:28.571928 20079 external_mini_cluster.cc:1428] Setting key 5c717043c8fb927eab1a04735ebc9552
I20260811 18:59:28.575197 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 18:59:28 dist-test-slave-1nl6 krb5kdc[22473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:59:28.586539 22620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494: Bootstrap starting.
I20260811 18:59:28.590288 22620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:28.591699 22620 log.cc:824] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:28.595436 22620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494: No bootstrap required, opened a new log
I20260811 18:59:28.596024 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:28.573930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:34197 (local address 127.0.0.1:34469)
0811 18:59:28.574722 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:28.574735 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:28.574777 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:59:28.576733 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:28.576757 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:28.577167 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:28.577573 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:28.579163 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:28.580606 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:28.581934 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:28.582634 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:28.582854 (+ 220us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:28.587617 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:28.587626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:28.587643 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:28.587691 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:28.591129 (+ 3438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:28.592280 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:28.592288 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:28.592317 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:28.592608 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:28.593103 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:28.593111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:28.593114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:28.593724 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:28.593973 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:28.594511 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 18:59:28.594848 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":320,"threads_started":1}
I20260811 18:59:28.600234 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:28.605569 22620 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } }
I20260811 18:59:28.606156 22620 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:28.606292 22620 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9868f66f045455bb8b7903cc6971494, State: Initialized, Role: FOLLOWER
I20260811 18:59:28.607129 22620 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } }
I20260811 18:59:28.607409 22620 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:28.607587 22620 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:28.607770 22620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:28.610749 22620 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } }
I20260811 18:59:28.611418 22620 leader_election.cc:302] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9868f66f045455bb8b7903cc6971494; no voters:
I20260811 18:59:28.612169 22620 leader_election.cc:288] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:28.612314 22643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:28.614456 22620 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:28.615141 22643 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [term 1 LEADER]: Becoming Leader. State: Replica: f9868f66f045455bb8b7903cc6971494, State: Running, Role: LEADER
I20260811 18:59:28.615828 22643 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } }
I20260811 18:59:28.620280 22650 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9868f66f045455bb8b7903cc6971494. Latest consensus state: current_term: 1 leader_uuid: "f9868f66f045455bb8b7903cc6971494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } } }
I20260811 18:59:28.620711 22650 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:28.622089 22644 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9868f66f045455bb8b7903cc6971494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9868f66f045455bb8b7903cc6971494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34469 } } }
I20260811 18:59:28.622470 22644 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:28.627296 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:28.605766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:35347 (local address 127.0.0.1:34469)
0811 18:59:28.605968 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:28.605975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:28.606554 (+ 579us) server_negotiation.cc:407] Connection header received
0811 18:59:28.606753 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:28.606758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:28.606841 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:28.606996 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:28.608769 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:28.609961 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:28.611347 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:28.612089 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:28.612257 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:28.616382 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:28.616389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:28.616394 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:28.616443 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:28.621483 (+ 5040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:28.622872 (+ 1389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:28.622881 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:28.622887 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:28.623148 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:28.623936 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:28.623945 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:28.623951 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:28.624493 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:28.624887 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:28.626402 (+ 1515us) server_negotiation.cc:299] Negotiation successful
0811 18:59:28.626672 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 18:59:28.632217 22664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:28.638630 22664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:28.648249 22664 catalog_manager.cc:1347] Generated new cluster ID: 9cd55b5746984871ba8ebf994b2084f6
I20260811 18:59:28.648399 22664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:28.668752 22664 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:28.670430 22664 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:28.677160 22664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9868f66f045455bb8b7903cc6971494: Generated new TSK 0
I20260811 18:59:28.678081 22664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:28.687003 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22499
I20260811 18:59:28.688766 22613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:28.782644 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22499
W20260811 18:59:28.812681 22471 connection.cc:535] client connection to 127.0.0.1:34469 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34469): Connection reset by peer (error 104)
2026-08-11T18:59:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2482 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:28 dist-test-slave-1nl6 krb5kdc[22688](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:28 dist-test-slave-1nl6 krb5kdc[22688](info): set up 2 sockets
Aug 11 18:59:28 dist-test-slave-1nl6 krb5kdc[22688](info): commencing operation
krb5kdc: starting...
W20260811 18:59:30.174368 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:30 dist-test-slave-1nl6 krb5kdc[22688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:30.534410 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40537
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:30.900113 22713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:30.900435 22713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:30.900625 22713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:30.908850 22713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:30.909001 22713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:30.909111 22713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:30.909210 22713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:30.909286 22713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:30.919754 22713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:30.921157 22713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:30.922559 22713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:30.936712 22719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:30.936784 22720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:30.936795 22723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:30.938097 22713 server_base.cc:1034] running on GCE node
I20260811 18:59:30.939016 22713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:30.940569 22713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:30.941862 22713 hybrid_clock.cc:648] HybridClock initialized: now 1786474770941869 us; error 102 us; skew 500 ppm
I20260811 18:59:30.942286 22713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:30 dist-test-slave-1nl6 krb5kdc[22688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474770, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:30.945786 22713 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:30.947660 22713 webserver.cc:460] Webserver started at http://127.0.0.1:37083/ using document root <none> and password file <none>
I20260811 18:59:30.948398 22713 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:30.948558 22713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:30.948894 22713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:30.952193 22713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "67062cf6167d4faa97bda935cf4880bf"
format_stamp: "Formatted at 2026-08-11 18:59:30 on dist-test-slave-1nl6"
server_key: "f6307cc01fe9221bd2b88404b4e492d5"
server_key_iv: "697817e596fc6485e1fc7f29af6af94f"
server_key_version: "encryptionkey@0"
I20260811 18:59:30.953042 22713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "67062cf6167d4faa97bda935cf4880bf"
format_stamp: "Formatted at 2026-08-11 18:59:30 on dist-test-slave-1nl6"
server_key: "f6307cc01fe9221bd2b88404b4e492d5"
server_key_iv: "697817e596fc6485e1fc7f29af6af94f"
server_key_version: "encryptionkey@0"
I20260811 18:59:30.958629 22713 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 18:59:30.962369 22734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:30.963742 22713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:30.963954 22713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "67062cf6167d4faa97bda935cf4880bf"
format_stamp: "Formatted at 2026-08-11 18:59:30 on dist-test-slave-1nl6"
server_key: "f6307cc01fe9221bd2b88404b4e492d5"
server_key_iv: "697817e596fc6485e1fc7f29af6af94f"
server_key_version: "encryptionkey@0"
I20260811 18:59:30.964178 22713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:30.984498 22713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:30.989389 22713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:30.989719 22713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:31.009816 22713 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40537
I20260811 18:59:31.009851 22818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40537 every 8 connection(s)
I20260811 18:59:31.011355 22713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:31.015266 22820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:31.020651 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22713
I20260811 18:59:31.020845 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:31.021342 20079 external_mini_cluster.cc:1428] Setting key dc1a56ea35c30831f892ae2e9eceb8ff
I20260811 18:59:31.027004 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf: Bootstrap starting.
I20260811 18:59:31.030221 22820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:31.031450 22820 log.cc:824] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:31.034833 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf: No bootstrap required, opened a new log
I20260811 18:59:31.035283 22825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:31.023451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:46027 (local address 127.0.0.1:40537)
0811 18:59:31.024288 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:31.024301 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:31.024346 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:59:31.026095 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:31.026120 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:31.026515 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:31.026974 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:31.027528 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:31.028853 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:31.030226 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:31.031083 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:31.031316 (+ 233us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:31.032756 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:31.032770 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:31.032792 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:31.033413 (+ 621us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:31.033489 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:31.033516 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:31.033641 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:31.033971 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 18:59:31.034188 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":343,"threads_started":1}
I20260811 18:59:31.039574 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:31.043648 22820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260811 18:59:31.044164 22820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:31.044313 22820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67062cf6167d4faa97bda935cf4880bf, State: Initialized, Role: FOLLOWER
I20260811 18:59:31.044991 22820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260811 18:59:31.045327 22820 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:31.045492 22820 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:31.045675 22820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:31.048629 22820 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260811 18:59:31.049296 22820 leader_election.cc:302] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67062cf6167d4faa97bda935cf4880bf; no voters:
I20260811 18:59:31.049997 22820 leader_election.cc:288] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:31.050179 22840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:31.051971 22825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:31.044276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:49051 (local address 127.0.0.1:40537)
0811 18:59:31.044525 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:31.044531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:31.044884 (+ 353us) server_negotiation.cc:407] Connection header received
0811 18:59:31.045066 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:31.045071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:31.045156 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:31.045277 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:31.045939 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:31.047154 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:31.048467 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:31.049156 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:31.049290 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:31.050649 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:31.050659 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:31.050667 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:31.050698 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:31.050808 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:31.050860 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:31.051473 (+ 613us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:31.051548 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 18:59:31.051603 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:59:31.052034 22840 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [term 1 LEADER]: Becoming Leader. State: Replica: 67062cf6167d4faa97bda935cf4880bf, State: Running, Role: LEADER
I20260811 18:59:31.052834 22840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260811 18:59:31.053081 22820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:31.055966 22842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67062cf6167d4faa97bda935cf4880bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } } }
I20260811 18:59:31.056432 22842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:31.055984 22844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67062cf6167d4faa97bda935cf4880bf. Latest consensus state: current_term: 1 leader_uuid: "67062cf6167d4faa97bda935cf4880bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67062cf6167d4faa97bda935cf4880bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } } }
I20260811 18:59:31.057904 22844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:31.059623 22854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:31.065505 22854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:31.074571 22854 catalog_manager.cc:1347] Generated new cluster ID: 040ab1c67caf4d0bac82bdba30e81c8c
I20260811 18:59:31.074699 22854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:31.105168 22854 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:31.106556 22854 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:31.117475 22854 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67062cf6167d4faa97bda935cf4880bf: Generated new TSK 0
I20260811 18:59:31.118358 22854 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:31.133893 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22713
W20260811 18:59:31.137472 22812 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.98:46027
W20260811 18:59:31.138418 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22713: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:31.138645 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22713
W20260811 18:59:31.167886 22684 connection.cc:535] client connection to 127.0.0.1:40537 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40537): Connection reset by peer (error 104)
2026-08-11T18:59:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2354 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:31 dist-test-slave-1nl6 krb5kdc[22874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:31 dist-test-slave-1nl6 krb5kdc[22874](info): set up 2 sockets
Aug 11 18:59:31 dist-test-slave-1nl6 krb5kdc[22874](info): commencing operation
krb5kdc: starting...
W20260811 18:59:32.524384 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.002s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:32 dist-test-slave-1nl6 krb5kdc[22874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:32.890473 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42995
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:33.262773 22892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:33.263216 22892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:33.263387 22892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:33.271283 22892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:33.271466 22892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:33.271572 22892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:33.271692 22892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:33.271782 22892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:33.282330 22892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:33.283906 22892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:33.285395 22892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:33.298688 22912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:33.298727 22914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:33.298688 22909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:33.299600 22892 server_base.cc:1034] running on GCE node
I20260811 18:59:33.300525 22892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:33.302131 22892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:33.303392 22892 hybrid_clock.cc:648] HybridClock initialized: now 1786474773303341 us; error 59 us; skew 500 ppm
I20260811 18:59:33.303891 22892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:33 dist-test-slave-1nl6 krb5kdc[22874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474773, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:33.307392 22892 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:33.309019 22892 webserver.cc:460] Webserver started at http://127.0.0.1:36877/ using document root <none> and password file <none>
I20260811 18:59:33.309784 22892 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:33.309949 22892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:33.310303 22892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:33.313710 22892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "45ddafea0a544e12a67aa09830f88b58"
format_stamp: "Formatted at 2026-08-11 18:59:33 on dist-test-slave-1nl6"
server_key: "2a768aa7f5357488008dfec46e2ce504"
server_key_iv: "2b1ff09beeed4fb678ee1377c6beff7f"
server_key_version: "encryptionkey@0"
I20260811 18:59:33.314580 22892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "45ddafea0a544e12a67aa09830f88b58"
format_stamp: "Formatted at 2026-08-11 18:59:33 on dist-test-slave-1nl6"
server_key: "2a768aa7f5357488008dfec46e2ce504"
server_key_iv: "2b1ff09beeed4fb678ee1377c6beff7f"
server_key_version: "encryptionkey@0"
I20260811 18:59:33.320530 22892 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:59:33.324188 22926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:33.325603 22892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:33.325812 22892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "45ddafea0a544e12a67aa09830f88b58"
format_stamp: "Formatted at 2026-08-11 18:59:33 on dist-test-slave-1nl6"
server_key: "2a768aa7f5357488008dfec46e2ce504"
server_key_iv: "2b1ff09beeed4fb678ee1377c6beff7f"
server_key_version: "encryptionkey@0"
I20260811 18:59:33.326035 22892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:33.332419 22892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:33.336927 22892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:33.337255 22892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:33.356940 22892 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42995
I20260811 18:59:33.357002 23030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42995 every 8 connection(s)
I20260811 18:59:33.358521 22892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:33.362687 23032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:33.367749 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 22892
I20260811 18:59:33.367949 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:33.368430 20079 external_mini_cluster.cc:1428] Setting key 005ca08ddf1f5ea22aa7d4ee4406cf2e
I20260811 18:59:33.376423 23032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58: Bootstrap starting.
I20260811 18:59:33.378399 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:33.370507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:49289 (local address 127.0.0.1:42995)
0811 18:59:33.371451 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:33.371470 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:33.371524 (+ 54us) server_negotiation.cc:407] Connection header received
0811 18:59:33.374176 (+ 2652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:33.374215 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:33.374717 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:33.375237 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:33.376294 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:33.376303 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:33.376320 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:33.376339 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:33.376418 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:33.376450 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:33.376696 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:33.376868 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 18:59:33.377085 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":415,"threads_started":1}
I20260811 18:59:33.380666 23032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:33.382018 23032 log.cc:824] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:33.382493 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:33.385190 23032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58: No bootstrap required, opened a new log
I20260811 18:59:33.390162 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:33.387559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:36639 (local address 127.0.0.1:42995)
0811 18:59:33.387758 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:33.387764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:33.388006 (+ 242us) server_negotiation.cc:407] Connection header received
0811 18:59:33.388223 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:33.388232 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:33.388300 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:33.388422 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:33.389391 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:33.389396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:33.389401 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:33.389420 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:33.389470 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:33.389486 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:33.389611 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:33.389760 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:59:33.389838 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:59:33.394110 23032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } }
I20260811 18:59:33.394577 23032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:33.394691 23032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddafea0a544e12a67aa09830f88b58, State: Initialized, Role: FOLLOWER
I20260811 18:59:33.395399 23032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } }
I20260811 18:59:33.395677 23032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:33.395828 23032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:33.396019 23032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:33.398732 23032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } }
I20260811 18:59:33.399325 23032 leader_election.cc:302] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45ddafea0a544e12a67aa09830f88b58; no voters:
I20260811 18:59:33.399917 23032 leader_election.cc:288] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:33.400091 23054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:33.400811 23054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [term 1 LEADER]: Becoming Leader. State: Replica: 45ddafea0a544e12a67aa09830f88b58, State: Running, Role: LEADER
I20260811 18:59:33.401412 23054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } }
I20260811 18:59:33.402243 23032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:33.404353 23057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45ddafea0a544e12a67aa09830f88b58. Latest consensus state: current_term: 1 leader_uuid: "45ddafea0a544e12a67aa09830f88b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } } }
I20260811 18:59:33.404784 23057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:33.406441 23056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45ddafea0a544e12a67aa09830f88b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45ddafea0a544e12a67aa09830f88b58" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42995 } } }
I20260811 18:59:33.406718 23056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:33.407241 23067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:33.413654 23067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:33.423540 23067 catalog_manager.cc:1347] Generated new cluster ID: 14450073a93e467f804f3ab9511eb0bd
I20260811 18:59:33.423755 23067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:33.451053 23067 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:33.451537 23067 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:33.460929 23067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45ddafea0a544e12a67aa09830f88b58: Generated new TSK 0
I20260811 18:59:33.461874 23067 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:33.471531 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22892
W20260811 18:59:33.472764 23019 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.98:49289
W20260811 18:59:33.473618 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 22892: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:33.473798 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 22892
2026-08-11T18:59:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:33 dist-test-slave-1nl6 krb5kdc[23096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:33 dist-test-slave-1nl6 krb5kdc[23096](info): set up 2 sockets
Aug 11 18:59:33 dist-test-slave-1nl6 krb5kdc[23096](info): commencing operation
krb5kdc: starting...
W20260811 18:59:34.878664 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.355s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:35 dist-test-slave-1nl6 krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:35.244396 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46191
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:35.613164 23125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:35.613469 23125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:35.613637 23125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:35.621052 23125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:35.621167 23125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:35.621315 23125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:35.621430 23125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:35.621520 23125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:35.631582 23125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46191
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:35.632973 23125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:35.634382 23125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:35.646967 23134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:35.647037 23138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:35.647042 23136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:35.648263 23125 server_base.cc:1034] running on GCE node
I20260811 18:59:35.649093 23125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:35.650574 23125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:35.651775 23125 hybrid_clock.cc:648] HybridClock initialized: now 1786474775651694 us; error 78 us; skew 500 ppm
I20260811 18:59:35.652163 23125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:35 dist-test-slave-1nl6 krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474775, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:35.655529 23125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:35.657042 23125 webserver.cc:460] Webserver started at http://127.0.0.1:37243/ using document root <none> and password file <none>
I20260811 18:59:35.657711 23125 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:35.657829 23125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:35.658107 23125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:35.661320 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "47935173e78a4303896a8fb111004f68"
format_stamp: "Formatted at 2026-08-11 18:59:35 on dist-test-slave-1nl6"
server_key: "94afc4cc491af4232eca73896cddd798"
server_key_iv: "3ad0c11c3d21d67ae7782e7bdce2a087"
server_key_version: "encryptionkey@0"
I20260811 18:59:35.662230 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "47935173e78a4303896a8fb111004f68"
format_stamp: "Formatted at 2026-08-11 18:59:35 on dist-test-slave-1nl6"
server_key: "94afc4cc491af4232eca73896cddd798"
server_key_iv: "3ad0c11c3d21d67ae7782e7bdce2a087"
server_key_version: "encryptionkey@0"
I20260811 18:59:35.667685 23125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 18:59:35.671849 23150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:35.673518 23125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:35.673832 23125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "47935173e78a4303896a8fb111004f68"
format_stamp: "Formatted at 2026-08-11 18:59:35 on dist-test-slave-1nl6"
server_key: "94afc4cc491af4232eca73896cddd798"
server_key_iv: "3ad0c11c3d21d67ae7782e7bdce2a087"
server_key_version: "encryptionkey@0"
I20260811 18:59:35.674080 23125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:35.686307 23125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:35.691227 23125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:35.691545 23125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:35.711263 23125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46191
I20260811 18:59:35.711284 23244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46191 every 8 connection(s)
I20260811 18:59:35.712973 23125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:35.717260 23245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:35.720919 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23125
I20260811 18:59:35.721138 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:35.721650 20079 external_mini_cluster.cc:1428] Setting key be85eee66330de0904e059a346f7fdb2
I20260811 18:59:35.732271 23245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68: Bootstrap starting.
I20260811 18:59:35.736532 23245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:35.737690 23245 log.cc:824] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:59:35 dist-test-slave-1nl6 krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:59:35.741551 23245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68: No bootstrap required, opened a new log
I20260811 18:59:35.749853 23248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:35.723843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:40027 (local address 127.0.0.1:46191)
0811 18:59:35.724751 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:35.724770 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:35.724828 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:59:35.727436 (+ 2608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:35.727480 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:35.728178 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:35.728734 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:35.730247 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:35.732459 (+ 2212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:35.733898 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:35.735118 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:35.735327 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:35.739788 (+ 4461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:35.739802 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:35.739824 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:35.739877 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:35.744130 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:35.745121 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:35.745133 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:35.745162 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:35.745402 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:35.746253 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:35.746258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:35.746261 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:35.747231 (+ 970us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:35.747591 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:35.748259 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 18:59:35.748638 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":407,"threads_started":1}
I20260811 18:59:35.752285 23245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } }
I20260811 18:59:35.752835 23245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:35.752977 23245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47935173e78a4303896a8fb111004f68, State: Initialized, Role: FOLLOWER
I20260811 18:59:35.753670 23245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } }
I20260811 18:59:35.753957 23245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:35.754125 23245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:35.754333 23245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:35.754796 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:35.757789 23245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } }
I20260811 18:59:35.758559 23245 leader_election.cc:302] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47935173e78a4303896a8fb111004f68; no voters:
I20260811 18:59:35.759456 23245 leader_election.cc:288] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:35.759615 23255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:35.762434 23245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:35.762861 23255 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [term 1 LEADER]: Becoming Leader. State: Replica: 47935173e78a4303896a8fb111004f68, State: Running, Role: LEADER
I20260811 18:59:35.763638 23255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } }
I20260811 18:59:35.767078 23258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47935173e78a4303896a8fb111004f68. Latest consensus state: current_term: 1 leader_uuid: "47935173e78a4303896a8fb111004f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } } }
I20260811 18:59:35.767565 23258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:35.768159 23256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47935173e78a4303896a8fb111004f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935173e78a4303896a8fb111004f68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46191 } } }
I20260811 18:59:35.768456 23256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:35.770479 23273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:35.777585 23273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:35.784107 23248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:35.760899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:33427 (local address 127.0.0.1:46191)
0811 18:59:35.761085 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:35.761091 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:35.761836 (+ 745us) server_negotiation.cc:407] Connection header received
0811 18:59:35.762178 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:35.762183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:35.762270 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:35.762348 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:35.764919 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:35.766512 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:35.768961 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:35.770029 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:35.770215 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:35.774382 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:35.774395 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:35.774406 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:35.774458 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:35.779089 (+ 4631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:35.780465 (+ 1376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:35.780471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:35.780474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:35.780652 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:35.781323 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:35.781329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:35.781332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:35.781824 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:35.782118 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:35.783496 (+ 1378us) server_negotiation.cc:299] Negotiation successful
0811 18:59:35.783731 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:59:35.789878 23273 catalog_manager.cc:1347] Generated new cluster ID: cf2a33c52f5947428318471de723751b
I20260811 18:59:35.790045 23273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:35.805047 23273 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:35.806422 23273 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:35.814891 23273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47935173e78a4303896a8fb111004f68: Generated new TSK 0
I20260811 18:59:35.816152 23273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:35.828365 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23125
I20260811 18:59:35.829882 23238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:35.923019 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23125
W20260811 18:59:35.948416 23092 connection.cc:535] client connection to 127.0.0.1:46191 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46191): Connection reset by peer (error 104)
2026-08-11T18:59:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:36 dist-test-slave-1nl6 krb5kdc[23299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:36 dist-test-slave-1nl6 krb5kdc[23299](info): set up 2 sockets
Aug 11 18:59:36 dist-test-slave-1nl6 krb5kdc[23299](info): commencing operation
krb5kdc: starting...
W20260811 18:59:37.347301 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.374s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:37 dist-test-slave-1nl6 krb5kdc[23299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:37.710134 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:38.067730 23330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:38.068048 23330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:38.068218 23330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:38.075549 23330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:38.075671 23330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:38.075762 23330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:38.075876 23330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:38.075945 23330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:38.086071 23330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42443
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:38.087659 23330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:38.089046 23330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:38.101738 23340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:38.101778 23346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:38.101832 23342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:38.103075 23330 server_base.cc:1034] running on GCE node
I20260811 18:59:38.103888 23330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:38.105372 23330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:38.106587 23330 hybrid_clock.cc:648] HybridClock initialized: now 1786474778106550 us; error 30 us; skew 500 ppm
I20260811 18:59:38.107048 23330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:38 dist-test-slave-1nl6 krb5kdc[23299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474778, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:38.110301 23330 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:38.111963 23330 webserver.cc:460] Webserver started at http://127.0.0.1:45011/ using document root <none> and password file <none>
I20260811 18:59:38.112700 23330 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:38.112843 23330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:38.113175 23330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:38.116411 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "1aff792d39d242fb8e1a83ab45faff89"
format_stamp: "Formatted at 2026-08-11 18:59:38 on dist-test-slave-1nl6"
server_key: "40956d977884c2d94ea5f8eb0ab74c59"
server_key_iv: "d71686539a77bd9ed746d50b91229103"
server_key_version: "encryptionkey@0"
I20260811 18:59:38.117236 23330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "1aff792d39d242fb8e1a83ab45faff89"
format_stamp: "Formatted at 2026-08-11 18:59:38 on dist-test-slave-1nl6"
server_key: "40956d977884c2d94ea5f8eb0ab74c59"
server_key_iv: "d71686539a77bd9ed746d50b91229103"
server_key_version: "encryptionkey@0"
I20260811 18:59:38.122838 23330 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 18:59:38.126557 23356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:38.128074 23330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:38.128291 23330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "1aff792d39d242fb8e1a83ab45faff89"
format_stamp: "Formatted at 2026-08-11 18:59:38 on dist-test-slave-1nl6"
server_key: "40956d977884c2d94ea5f8eb0ab74c59"
server_key_iv: "d71686539a77bd9ed746d50b91229103"
server_key_version: "encryptionkey@0"
I20260811 18:59:38.128520 23330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:38.146090 23330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:38.150475 23330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:38.150744 23330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:38.170230 23330 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42443
I20260811 18:59:38.170271 23455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42443 every 8 connection(s)
I20260811 18:59:38.171885 23330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:38.175432 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23330
I20260811 18:59:38.175632 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:38.176110 20079 external_mini_cluster.cc:1428] Setting key 6abf47bd52aee8f3648fd2c1209d6673
I20260811 18:59:38.176347 23457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:38.192242 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:38.178120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:41409 (local address 127.0.0.1:42443)
0811 18:59:38.179005 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:38.179022 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:38.179077 (+ 55us) server_negotiation.cc:407] Connection header received
0811 18:59:38.181500 (+ 2423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:38.181533 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:38.182098 (+ 565us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:38.182561 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:38.183164 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:38.185227 (+ 2063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:38.186684 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:38.187826 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:38.188015 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:38.189247 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:38.189257 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:38.189278 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:38.190063 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:38.190165 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:38.190210 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:38.190365 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:38.190615 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 18:59:38.190819 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":347,"threads_started":1}
I20260811 18:59:38.192451 23457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89: Bootstrap starting.
I20260811 18:59:38.195851 23457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:38.196310 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:38.197182 23457 log.cc:824] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:38.200883 23457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89: No bootstrap required, opened a new log
I20260811 18:59:38.209295 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:38.201983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:38701 (local address 127.0.0.1:42443)
0811 18:59:38.202231 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:38.202239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:38.202613 (+ 374us) server_negotiation.cc:407] Connection header received
0811 18:59:38.202849 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:38.202854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:38.202988 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:38.203082 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:38.203753 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:38.204555 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:38.206467 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:38.207021 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:38.207122 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:38.208421 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:38.208426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:38.208429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:38.208452 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:38.208514 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:38.208533 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:38.208627 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:38.208852 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 18:59:38.208899 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:59:38.211319 23457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } }
I20260811 18:59:38.211730 23457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:38.211856 23457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aff792d39d242fb8e1a83ab45faff89, State: Initialized, Role: FOLLOWER
I20260811 18:59:38.212555 23457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } }
I20260811 18:59:38.212816 23457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:38.212976 23457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:38.213160 23457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:38.215559 23457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } }
I20260811 18:59:38.216141 23457 leader_election.cc:302] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aff792d39d242fb8e1a83ab45faff89; no voters:
I20260811 18:59:38.216876 23457 leader_election.cc:288] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:38.217020 23477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:38.218115 23477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [term 1 LEADER]: Becoming Leader. State: Replica: 1aff792d39d242fb8e1a83ab45faff89, State: Running, Role: LEADER
I20260811 18:59:38.218755 23477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } }
I20260811 18:59:38.219632 23457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:38.221980 23480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aff792d39d242fb8e1a83ab45faff89. Latest consensus state: current_term: 1 leader_uuid: "1aff792d39d242fb8e1a83ab45faff89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } } }
I20260811 18:59:38.222398 23480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:38.222165 23478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1aff792d39d242fb8e1a83ab45faff89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aff792d39d242fb8e1a83ab45faff89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42443 } } }
I20260811 18:59:38.222573 23478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:38.224490 23489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:38.230055 23489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:38.240247 23489 catalog_manager.cc:1347] Generated new cluster ID: d65c53fd0ed848ad8dc096f3a01a64b7
I20260811 18:59:38.240473 23489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:38.252192 23489 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:38.254272 23489 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:38.269471 23489 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1aff792d39d242fb8e1a83ab45faff89: Generated new TSK 0
I20260811 18:59:38.270752 23489 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:38.278824 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23330
W20260811 18:59:38.280365 23450 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.98:41409
W20260811 18:59:38.281313 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23330: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:38.281486 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23330
W20260811 18:59:38.312619 23292 connection.cc:535] client connection to 127.0.0.1:42443 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42443): Connection reset by peer (error 104)
2026-08-11T18:59:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2359 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:38 dist-test-slave-1nl6 krb5kdc[23515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:38 dist-test-slave-1nl6 krb5kdc[23515](info): set up 2 sockets
Aug 11 18:59:38 dist-test-slave-1nl6 krb5kdc[23515](info): commencing operation
krb5kdc: starting...
W20260811 18:59:39.660974 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:39 dist-test-slave-1nl6 krb5kdc[23515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:59:40.018087 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39479
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:40.382515 23538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:40.382839 23538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:40.383075 23538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:40.390673 23538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:40.390810 23538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:40.390905 23538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:40.391045 23538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:40.391129 23538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:40.401594 23538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39479
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:40.403127 23538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:40.404532 23538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:40.417253 23546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:40.417201 23553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:40.417179 23547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:40.418058 23538 server_base.cc:1034] running on GCE node
I20260811 18:59:40.419011 23538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:40.420608 23538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:40.421862 23538 hybrid_clock.cc:648] HybridClock initialized: now 1786474780421812 us; error 39 us; skew 500 ppm
I20260811 18:59:40.422304 23538 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:40 dist-test-slave-1nl6 krb5kdc[23515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474780, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:40.430711 23538 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:59:40.432658 23538 webserver.cc:460] Webserver started at http://127.0.0.1:43287/ using document root <none> and password file <none>
I20260811 18:59:40.433465 23538 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:40.433632 23538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:40.433980 23538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:40.437403 23538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "00f3af56f96d44ceafe2937eab6d4dd9"
format_stamp: "Formatted at 2026-08-11 18:59:40 on dist-test-slave-1nl6"
server_key: "9e9264b07183650bb036f5319a6e86a0"
server_key_iv: "b7ffdc1c1d795fc62cf7b49e1c01fc65"
server_key_version: "encryptionkey@0"
I20260811 18:59:40.438277 23538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "00f3af56f96d44ceafe2937eab6d4dd9"
format_stamp: "Formatted at 2026-08-11 18:59:40 on dist-test-slave-1nl6"
server_key: "9e9264b07183650bb036f5319a6e86a0"
server_key_iv: "b7ffdc1c1d795fc62cf7b49e1c01fc65"
server_key_version: "encryptionkey@0"
I20260811 18:59:40.444051 23538 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 18:59:40.447911 23564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:40.449328 23538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 18:59:40.449545 23538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "00f3af56f96d44ceafe2937eab6d4dd9"
format_stamp: "Formatted at 2026-08-11 18:59:40 on dist-test-slave-1nl6"
server_key: "9e9264b07183650bb036f5319a6e86a0"
server_key_iv: "b7ffdc1c1d795fc62cf7b49e1c01fc65"
server_key_version: "encryptionkey@0"
I20260811 18:59:40.449772 23538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:40.456033 23538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:40.460614 23538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:40.460954 23538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:40.480906 23538 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39479
I20260811 18:59:40.480950 23669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39479 every 8 connection(s)
I20260811 18:59:40.482447 23538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:40.483004 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23538
I20260811 18:59:40.483193 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:40.483840 20079 external_mini_cluster.cc:1428] Setting key b4b84e9a5ba94f219a1cdf1bb044ac8a
I20260811 18:59:40.487135 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:40.491990 23673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:40.485755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:34607 (local address 127.0.0.1:39479)
0811 18:59:40.486555 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:40.486568 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:40.486614 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:59:40.488390 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:40.488416 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:40.488759 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:40.489174 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:40.490292 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:40.490299 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:40.490321 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:40.490339 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:40.490411 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:40.490430 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:40.490683 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:40.490849 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 18:59:40.491068 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":333,"threads_started":1}
I20260811 18:59:40.496181 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:40.499563 23670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9: Bootstrap starting.
I20260811 18:59:40.503132 23670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:40.503410 23673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:40.500826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.98:40757 (local address 127.0.0.1:39479)
0811 18:59:40.501038 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:40.501044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:40.501325 (+ 281us) server_negotiation.cc:407] Connection header received
0811 18:59:40.501522 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:40.501534 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:40.501591 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:40.501700 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:40.502685 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:40.502693 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:40.502701 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:40.502716 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:40.502755 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:40.502771 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:40.502896 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:40.503069 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 18:59:40.503141 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:59:40.504477 23670 log.cc:824] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:40.507565 23670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9: No bootstrap required, opened a new log
I20260811 18:59:40.515141 23670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260811 18:59:40.515623 23670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:40.515743 23670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f3af56f96d44ceafe2937eab6d4dd9, State: Initialized, Role: FOLLOWER
I20260811 18:59:40.516547 23670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260811 18:59:40.516781 23670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:40.516892 23670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:40.517023 23670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:40.519361 23670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260811 18:59:40.519862 23670 leader_election.cc:302] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00f3af56f96d44ceafe2937eab6d4dd9; no voters:
I20260811 18:59:40.520426 23670 leader_election.cc:288] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:40.520598 23684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:40.521302 23684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [term 1 LEADER]: Becoming Leader. State: Replica: 00f3af56f96d44ceafe2937eab6d4dd9, State: Running, Role: LEADER
I20260811 18:59:40.521910 23684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260811 18:59:40.522688 23670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:40.525009 23685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } } }
I20260811 18:59:40.525533 23685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:40.525404 23686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00f3af56f96d44ceafe2937eab6d4dd9. Latest consensus state: current_term: 1 leader_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f3af56f96d44ceafe2937eab6d4dd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } } }
I20260811 18:59:40.525672 23686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:40.526674 23693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:40.533907 23693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:40.544726 23693 catalog_manager.cc:1347] Generated new cluster ID: 9853089a745942d0b13795e97346de9b
I20260811 18:59:40.544888 23693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:40.569912 23693 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:40.570503 23693 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:40.587203 23693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00f3af56f96d44ceafe2937eab6d4dd9: Generated new TSK 0
I20260811 18:59:40.588196 23693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:40.599463 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23538
W20260811 18:59:40.600956 23659 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.98:34607
W20260811 18:59:40.601822 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23538: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:40.601995 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23538
2026-08-11T18:59:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2321 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:40 dist-test-slave-1nl6 krb5kdc[23719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:40 dist-test-slave-1nl6 krb5kdc[23719](info): set up 2 sockets
Aug 11 18:59:40 dist-test-slave-1nl6 krb5kdc[23719](info): commencing operation
krb5kdc: starting...
W20260811 18:59:41.991395 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.010s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:42 dist-test-slave-1nl6 krb5kdc[23719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:42.357826 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44035
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:42.723575 23739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:42.723963 23739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:42.724126 23739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:42.731833 23739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:42.732013 23739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:42.732146 23739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:42.732270 23739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:42.732354 23739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:42.742791 23739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44035
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:42.744372 23739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:42.745865 23739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:42.759002 23749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:42.758975 23756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:42.759055 23753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:42.759970 23739 server_base.cc:1034] running on GCE node
I20260811 18:59:42.760866 23739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:42.762475 23739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:42.763729 23739 hybrid_clock.cc:648] HybridClock initialized: now 1786474782763676 us; error 79 us; skew 500 ppm
I20260811 18:59:42.764124 23739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:42 dist-test-slave-1nl6 krb5kdc[23719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474782, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:42.767737 23739 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:42.769402 23739 webserver.cc:460] Webserver started at http://127.19.155.254:38127/ using document root <none> and password file <none>
I20260811 18:59:42.770174 23739 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:42.770337 23739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:42.770694 23739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:42.774121 23739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "33b387ad99184c2ba0be5d32e6f1e44b"
format_stamp: "Formatted at 2026-08-11 18:59:42 on dist-test-slave-1nl6"
server_key: "657a63e1f3f16dcfdf0a1caa18976918"
server_key_iv: "99732a1faee79741eb309bfd6e92e360"
server_key_version: "encryptionkey@0"
I20260811 18:59:42.775151 23739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "33b387ad99184c2ba0be5d32e6f1e44b"
format_stamp: "Formatted at 2026-08-11 18:59:42 on dist-test-slave-1nl6"
server_key: "657a63e1f3f16dcfdf0a1caa18976918"
server_key_iv: "99732a1faee79741eb309bfd6e92e360"
server_key_version: "encryptionkey@0"
I20260811 18:59:42.781198 23739 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 18:59:42.785421 23765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:42.787045 23739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:59:42.787281 23739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "33b387ad99184c2ba0be5d32e6f1e44b"
format_stamp: "Formatted at 2026-08-11 18:59:42 on dist-test-slave-1nl6"
server_key: "657a63e1f3f16dcfdf0a1caa18976918"
server_key_iv: "99732a1faee79741eb309bfd6e92e360"
server_key_version: "encryptionkey@0"
I20260811 18:59:42.787530 23739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:42.808000 23739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:42.813263 23739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:42.813591 23739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:42.834349 23739 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44035
I20260811 18:59:42.834375 23851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44035 every 8 connection(s)
I20260811 18:59:42.835984 23739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:42.840282 23855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:42.844149 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23739
I20260811 18:59:42.844383 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:42.844847 20079 external_mini_cluster.cc:1428] Setting key 4f5049cbd9db47e5f520368032bd4332
I20260811 18:59:42.853854 23855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b: Bootstrap starting.
I20260811 18:59:42.858381 23855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:42.859968 23855 log.cc:824] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:59:42 dist-test-slave-1nl6 krb5kdc[23719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:42.863899 23855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b: No bootstrap required, opened a new log
I20260811 18:59:42.871949 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:42.847046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42641 (local address 127.19.155.254:44035)
0811 18:59:42.847984 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:42.847998 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:42.848058 (+ 60us) server_negotiation.cc:407] Connection header received
0811 18:59:42.849888 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:42.849916 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:42.850412 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:42.850891 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:42.852535 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:42.853944 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:42.855984 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:42.856766 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:42.856914 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:42.862664 (+ 5750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:42.862678 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:42.862700 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:42.862746 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:42.866632 (+ 3886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:42.867876 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:42.867884 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:42.867892 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:42.868096 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:42.868657 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:42.868660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:42.868663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:42.869322 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:42.869615 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:42.870178 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 18:59:42.870650 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":419,"threads_started":1}
I20260811 18:59:42.874162 23855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } }
I20260811 18:59:42.874639 23855 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:42.874782 23855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b387ad99184c2ba0be5d32e6f1e44b, State: Initialized, Role: FOLLOWER
I20260811 18:59:42.875540 23855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } }
I20260811 18:59:42.875891 23855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:42.876055 23855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:42.876268 23855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:42.877172 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:42.878858 23855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } }
I20260811 18:59:42.879566 23855 leader_election.cc:302] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33b387ad99184c2ba0be5d32e6f1e44b; no voters:
I20260811 18:59:42.880337 23855 leader_election.cc:288] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:42.880455 23868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:42.882007 23868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [term 1 LEADER]: Becoming Leader. State: Replica: 33b387ad99184c2ba0be5d32e6f1e44b, State: Running, Role: LEADER
I20260811 18:59:42.882827 23868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } }
I20260811 18:59:42.883865 23855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:42.886385 23875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33b387ad99184c2ba0be5d32e6f1e44b. Latest consensus state: current_term: 1 leader_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } } }
I20260811 18:59:42.886833 23875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:42.887403 23874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33b387ad99184c2ba0be5d32e6f1e44b" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44035 } } }
I20260811 18:59:42.887761 23874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:42.888690 23886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:42.897878 23886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:42.908978 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:42.882330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59917 (local address 127.19.155.254:44035)
0811 18:59:42.882763 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:42.882773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:42.883400 (+ 627us) server_negotiation.cc:407] Connection header received
0811 18:59:42.883639 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:42.883644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:42.883727 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:42.883849 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:42.888722 (+ 4873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:42.889642 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:42.891128 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:42.891990 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:42.892152 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:42.896687 (+ 4535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:42.896698 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:42.896707 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:42.896791 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:42.902264 (+ 5473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:42.904047 (+ 1783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:42.904058 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:42.904067 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:42.904305 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:42.905123 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:42.905131 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:42.905138 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:42.905801 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:42.906213 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:42.908101 (+ 1888us) server_negotiation.cc:299] Negotiation successful
0811 18:59:42.908386 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:59:42.913933 23886 catalog_manager.cc:1347] Generated new cluster ID: 4d52f9ba1cba4cdb9f4180f09e89af91
I20260811 18:59:42.914194 23886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:42.940483 23886 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:42.941941 23886 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:42.950472 23886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33b387ad99184c2ba0be5d32e6f1e44b: Generated new TSK 0
I20260811 18:59:42.951498 23886 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:42.960705 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23739
I20260811 18:59:42.961992 23847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:43.056784 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23739
W20260811 18:59:43.085590 23715 connection.cc:535] client connection to 127.19.155.254:44035 recv error: Network error: failed to read from TLS socket (remote: 127.19.155.254:44035): Connection reset by peer (error 104)
2026-08-11T18:59:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:43 dist-test-slave-1nl6 krb5kdc[23914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:43 dist-test-slave-1nl6 krb5kdc[23914](info): set up 2 sockets
Aug 11 18:59:43 dist-test-slave-1nl6 krb5kdc[23914](info): commencing operation
krb5kdc: starting...
W20260811 18:59:44.482889 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.377s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:44 dist-test-slave-1nl6 krb5kdc[23914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:44.852806 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:33629
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:33307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:33629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:45.224280 23932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:45.224597 23932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:45.224774 23932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:45.232271 23932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:45.232393 23932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:45.232496 23932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:45.232606 23932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:45.232692 23932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:45.243018 23932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:33307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:33629
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:33629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:45.244470 23932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:45.245882 23932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:45.258726 23938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:45.258642 23939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:45.258715 23944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:45.259511 23932 server_base.cc:1034] running on GCE node
I20260811 18:59:45.260396 23932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:45.261965 23932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:45.263221 23932 hybrid_clock.cc:648] HybridClock initialized: now 1786474785263159 us; error 60 us; skew 500 ppm
I20260811 18:59:45.263592 23932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:45 dist-test-slave-1nl6 krb5kdc[23914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474785, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:45.266870 23932 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:45.268476 23932 webserver.cc:460] Webserver started at http://127.19.155.254:36287/ using document root <none> and password file <none>
I20260811 18:59:45.269203 23932 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:45.269358 23932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:45.269686 23932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:45.273509 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "fd3827e563f34acab0ebe291ffa25ef5"
format_stamp: "Formatted at 2026-08-11 18:59:45 on dist-test-slave-1nl6"
server_key: "7ce2e61d31f5f87583af20cd0315fdfd"
server_key_iv: "abc6ec1a4c388e39327d8e7422a70dac"
server_key_version: "encryptionkey@0"
I20260811 18:59:45.274498 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "fd3827e563f34acab0ebe291ffa25ef5"
format_stamp: "Formatted at 2026-08-11 18:59:45 on dist-test-slave-1nl6"
server_key: "7ce2e61d31f5f87583af20cd0315fdfd"
server_key_iv: "abc6ec1a4c388e39327d8e7422a70dac"
server_key_version: "encryptionkey@0"
I20260811 18:59:45.280560 23932 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 18:59:45.284300 23957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:45.285668 23932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:45.285866 23932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "fd3827e563f34acab0ebe291ffa25ef5"
format_stamp: "Formatted at 2026-08-11 18:59:45 on dist-test-slave-1nl6"
server_key: "7ce2e61d31f5f87583af20cd0315fdfd"
server_key_iv: "abc6ec1a4c388e39327d8e7422a70dac"
server_key_version: "encryptionkey@0"
I20260811 18:59:45.286082 23932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:45.315393 23932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:45.319933 23932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:45.320276 23932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:45.340319 23932 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:33629
I20260811 18:59:45.340338 24043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:33629 every 8 connection(s)
I20260811 18:59:45.341840 23932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:45.345813 24045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:45.352059 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 23932
I20260811 18:59:45.352311 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:45.352874 20079 external_mini_cluster.cc:1428] Setting key 56c8cc371bdfd25fa9850ae7293fd7d7
I20260811 18:59:45.358067 24045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5: Bootstrap starting.
I20260811 18:59:45.362149 24045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:45.363552 24045 log.cc:824] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:45.366876 24045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5: No bootstrap required, opened a new log
I20260811 18:59:45.367969 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:45.355009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45581 (local address 127.19.155.254:33629)
0811 18:59:45.356064 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:45.356077 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:45.356123 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:59:45.357903 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:45.357931 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:45.358461 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:45.358841 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:45.359576 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:45.360972 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:45.363033 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:45.363848 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:45.364001 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:45.365472 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:45.365482 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:45.365498 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:45.366059 (+ 561us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:45.366138 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:45.366166 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:45.366348 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:45.366648 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 18:59:45.366836 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":555,"threads_started":1}
I20260811 18:59:45.372599 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:45.375957 24045 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } }
I20260811 18:59:45.376385 24045 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:45.376492 24045 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3827e563f34acab0ebe291ffa25ef5, State: Initialized, Role: FOLLOWER
I20260811 18:59:45.377231 24045 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } }
I20260811 18:59:45.377686 24045 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:45.377892 24045 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:45.378101 24045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:45.381567 24045 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } }
I20260811 18:59:45.382256 24045 leader_election.cc:302] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd3827e563f34acab0ebe291ffa25ef5; no voters:
I20260811 18:59:45.383085 24045 leader_election.cc:288] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:45.383193 24059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:45.384347 24059 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [term 1 LEADER]: Becoming Leader. State: Replica: fd3827e563f34acab0ebe291ffa25ef5, State: Running, Role: LEADER
I20260811 18:59:45.384999 24059 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } }
I20260811 18:59:45.385670 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:45.377435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36883 (local address 127.19.155.254:33629)
0811 18:59:45.377719 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:45.377726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:45.378112 (+ 386us) server_negotiation.cc:407] Connection header received
0811 18:59:45.378414 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:45.378419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:45.378516 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:45.378628 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:45.379385 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:45.380233 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:45.382075 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:45.382596 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:45.382696 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:45.384709 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:45.384716 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:45.384721 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:45.384744 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:45.384794 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:45.384814 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:45.384945 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:45.385235 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 18:59:45.385301 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 18:59:45.386114 24045 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:45.388238 24060 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd3827e563f34acab0ebe291ffa25ef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } } }
I20260811 18:59:45.388670 24060 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:45.389969 24064 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd3827e563f34acab0ebe291ffa25ef5. Latest consensus state: current_term: 1 leader_uuid: "fd3827e563f34acab0ebe291ffa25ef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3827e563f34acab0ebe291ffa25ef5" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 33629 } } }
I20260811 18:59:45.391407 24064 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:45.391819 24075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:45.397351 24075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:45.407526 24075 catalog_manager.cc:1347] Generated new cluster ID: d14429146fa8483dbcc81d2faf584d9e
I20260811 18:59:45.407682 24075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:45.436663 24075 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:45.438705 24075 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:45.454280 24075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd3827e563f34acab0ebe291ffa25ef5: Generated new TSK 0
I20260811 18:59:45.455394 24075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:45.468057 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23932
W20260811 18:59:45.469445 24038 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45581
W20260811 18:59:45.470280 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 23932: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:45.470410 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 23932
W20260811 18:59:45.500108 23910 connection.cc:535] client connection to 127.19.155.254:33629 recv error: Network error: failed to read from TLS socket (remote: 127.19.155.254:33629): Connection reset by peer (error 104)
2026-08-11T18:59:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:45 dist-test-slave-1nl6 krb5kdc[24103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:45 dist-test-slave-1nl6 krb5kdc[24103](info): set up 2 sockets
Aug 11 18:59:45 dist-test-slave-1nl6 krb5kdc[24103](info): commencing operation
krb5kdc: starting...
W20260811 18:59:46.859812 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:47 dist-test-slave-1nl6 krb5kdc[24103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:47.218387 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34709
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:34709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:47.590476 24122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:47.590808 24122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:47.590997 24122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:47.598697 24122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:47.598837 24122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:47.598963 24122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:47.599081 24122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:47.599148 24122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:47.609951 24122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:34709
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:34709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:47.611464 24122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:47.612931 24122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:47.626643 24131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:47.626605 24134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:47.626694 24130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:47.627579 24122 server_base.cc:1034] running on GCE node
I20260811 18:59:47.628422 24122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:47.629985 24122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:47.631268 24122 hybrid_clock.cc:648] HybridClock initialized: now 1786474787631214 us; error 65 us; skew 500 ppm
I20260811 18:59:47.631719 24122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:47 dist-test-slave-1nl6 krb5kdc[24103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474787, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:47.635208 24122 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:47.636931 24122 webserver.cc:460] Webserver started at http://127.19.155.254:40675/ using document root <none> and password file <none>
I20260811 18:59:47.637718 24122 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:47.637885 24122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:47.638230 24122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:47.641633 24122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "8cc81a56461c471dba212003de5e5cf0"
format_stamp: "Formatted at 2026-08-11 18:59:47 on dist-test-slave-1nl6"
server_key: "bdd4fcfaed02121cfc44591afa947f90"
server_key_iv: "c2ecd874ea72018f6832c14bc83368b0"
server_key_version: "encryptionkey@0"
I20260811 18:59:47.642551 24122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "8cc81a56461c471dba212003de5e5cf0"
format_stamp: "Formatted at 2026-08-11 18:59:47 on dist-test-slave-1nl6"
server_key: "bdd4fcfaed02121cfc44591afa947f90"
server_key_iv: "c2ecd874ea72018f6832c14bc83368b0"
server_key_version: "encryptionkey@0"
I20260811 18:59:47.648329 24122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 18:59:47.652120 24144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:47.653560 24122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:47.653785 24122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "8cc81a56461c471dba212003de5e5cf0"
format_stamp: "Formatted at 2026-08-11 18:59:47 on dist-test-slave-1nl6"
server_key: "bdd4fcfaed02121cfc44591afa947f90"
server_key_iv: "c2ecd874ea72018f6832c14bc83368b0"
server_key_version: "encryptionkey@0"
I20260811 18:59:47.654016 24122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:47.660202 24122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:47.665105 24122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:47.665453 24122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:47.685936 24122 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:34709
I20260811 18:59:47.685974 24228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:34709 every 8 connection(s)
I20260811 18:59:47.687608 24122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:47.691967 24230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:47.695614 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24122
I20260811 18:59:47.695842 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:47.696401 20079 external_mini_cluster.cc:1428] Setting key 97fed6d0c7283836d66e7330d0be55ba
I20260811 18:59:47.705607 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:47.698602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58403 (local address 127.19.155.254:34709)
0811 18:59:47.699620 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:47.699635 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:47.699694 (+ 59us) server_negotiation.cc:407] Connection header received
0811 18:59:47.701460 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:47.701486 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:47.701890 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:47.702404 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:47.703718 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:47.703726 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:47.703744 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:47.703760 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:47.703821 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:47.703845 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:47.704121 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:47.704297 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 18:59:47.704536 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":491,"threads_started":1}
I20260811 18:59:47.706086 24230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0: Bootstrap starting.
I20260811 18:59:47.710004 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:47.710181 24230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:47.711424 24230 log.cc:824] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:47.714951 24230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0: No bootstrap required, opened a new log
I20260811 18:59:47.718364 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:47.715205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59567 (local address 127.19.155.254:34709)
0811 18:59:47.715414 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:47.715422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:47.716059 (+ 637us) server_negotiation.cc:407] Connection header received
0811 18:59:47.716268 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:47.716272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:47.716323 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:47.716409 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:47.717484 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:47.717489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:47.717493 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:47.717510 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:47.717559 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:47.717575 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:47.717679 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:47.717877 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 18:59:47.717950 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 18:59:47.724220 24230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } }
I20260811 18:59:47.724711 24230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:47.724838 24230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc81a56461c471dba212003de5e5cf0, State: Initialized, Role: FOLLOWER
I20260811 18:59:47.725562 24230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } }
I20260811 18:59:47.725852 24230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:47.726020 24230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:47.726234 24230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:47.728749 24230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } }
I20260811 18:59:47.729378 24230 leader_election.cc:302] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cc81a56461c471dba212003de5e5cf0; no voters:
I20260811 18:59:47.730166 24230 leader_election.cc:288] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:47.730325 24247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:47.731168 24247 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 8cc81a56461c471dba212003de5e5cf0, State: Running, Role: LEADER
I20260811 18:59:47.731789 24247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } }
I20260811 18:59:47.732642 24230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:47.734931 24250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cc81a56461c471dba212003de5e5cf0. Latest consensus state: current_term: 1 leader_uuid: "8cc81a56461c471dba212003de5e5cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } } }
I20260811 18:59:47.735386 24250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:47.736390 24248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cc81a56461c471dba212003de5e5cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc81a56461c471dba212003de5e5cf0" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 34709 } } }
I20260811 18:59:47.736786 24248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:47.739018 24254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:47.744776 24254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:47.755000 24254 catalog_manager.cc:1347] Generated new cluster ID: ba332e8cc4fe42478b891a4af48ff5be
I20260811 18:59:47.755151 24254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:47.775064 24254 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:47.775590 24254 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:47.787540 24254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cc81a56461c471dba212003de5e5cf0: Generated new TSK 0
I20260811 18:59:47.788583 24254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:47.797205 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24122
W20260811 18:59:47.798523 24221 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58403
W20260811 18:59:47.799458 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24122: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:47.799633 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24122
2026-08-11T18:59:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:47 dist-test-slave-1nl6 krb5kdc[24281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:47 dist-test-slave-1nl6 krb5kdc[24281](info): set up 2 sockets
Aug 11 18:59:47 dist-test-slave-1nl6 krb5kdc[24281](info): commencing operation
krb5kdc: starting...
W20260811 18:59:49.218053 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:49 dist-test-slave-1nl6 krb5kdc[24281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:49.599990 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:37093
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:45703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:37093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:49.974098 24303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:49.974524 24303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:49.974696 24303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:49.982307 24303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:49.982509 24303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:49.982628 24303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:49.982743 24303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:49.982829 24303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:49.993453 24303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:45703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:37093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:37093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:49.995046 24303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:49.996519 24303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:50.009815 24309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:50.009857 24311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:50.009896 24318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:50.010686 24303 server_base.cc:1034] running on GCE node
I20260811 18:59:50.011685 24303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:50.013384 24303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:50.014636 24303 hybrid_clock.cc:648] HybridClock initialized: now 1786474790014585 us; error 49 us; skew 500 ppm
I20260811 18:59:50.015121 24303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:50 dist-test-slave-1nl6 krb5kdc[24281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474790, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:50.018829 24303 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:50.020665 24303 webserver.cc:460] Webserver started at http://127.19.155.254:40719/ using document root <none> and password file <none>
I20260811 18:59:50.021440 24303 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:50.021598 24303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:50.021930 24303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:50.025270 24303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "2717f57c183742858c57d6650bbe237a"
format_stamp: "Formatted at 2026-08-11 18:59:50 on dist-test-slave-1nl6"
server_key: "7ad1847f7c0c365af50ddceadb475aac"
server_key_iv: "f747e46c0e2fc1e4c0ed95945fab95d3"
server_key_version: "encryptionkey@0"
I20260811 18:59:50.026170 24303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "2717f57c183742858c57d6650bbe237a"
format_stamp: "Formatted at 2026-08-11 18:59:50 on dist-test-slave-1nl6"
server_key: "7ad1847f7c0c365af50ddceadb475aac"
server_key_iv: "f747e46c0e2fc1e4c0ed95945fab95d3"
server_key_version: "encryptionkey@0"
I20260811 18:59:50.032226 24303 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 18:59:50.036322 24326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:50.037882 24303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 18:59:50.038133 24303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "2717f57c183742858c57d6650bbe237a"
format_stamp: "Formatted at 2026-08-11 18:59:50 on dist-test-slave-1nl6"
server_key: "7ad1847f7c0c365af50ddceadb475aac"
server_key_iv: "f747e46c0e2fc1e4c0ed95945fab95d3"
server_key_version: "encryptionkey@0"
I20260811 18:59:50.038380 24303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:50.064607 24303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:50.069132 24303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:50.069465 24303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:50.089210 24303 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:37093
I20260811 18:59:50.089246 24412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:37093 every 8 connection(s)
I20260811 18:59:50.090790 24303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:50.095082 24413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:50.097601 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24303
I20260811 18:59:50.097842 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:50.098452 20079 external_mini_cluster.cc:1428] Setting key 50fbae5556261c70df27f6c0f16d7086
I20260811 18:59:50.107585 24413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a: Bootstrap starting.
I20260811 18:59:50.111209 24413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:50.112360 24413 log.cc:824] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:59:50 dist-test-slave-1nl6 krb5kdc[24281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:50.115855 24413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a: No bootstrap required, opened a new log
I20260811 18:59:50.123450 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:50.100696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39517 (local address 127.19.155.254:37093)
0811 18:59:50.101594 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:50.101607 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:50.101660 (+ 53us) server_negotiation.cc:407] Connection header received
0811 18:59:50.103492 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:50.103519 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:50.103970 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:50.104422 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:50.106037 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:50.107506 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:50.108953 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:50.109693 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:50.109908 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:50.115042 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:50.115052 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:50.115069 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:50.115109 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:50.118507 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:50.119523 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:50.119531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:50.119538 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:50.119742 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:50.120229 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:50.120233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:50.120235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:50.120901 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:50.121166 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:50.121706 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 18:59:50.122187 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":385,"threads_started":1}
I20260811 18:59:50.125260 24413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } }
I20260811 18:59:50.125703 24413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:50.125855 24413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2717f57c183742858c57d6650bbe237a, State: Initialized, Role: FOLLOWER
I20260811 18:59:50.126521 24413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } }
I20260811 18:59:50.126806 24413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:50.126983 24413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:50.127206 24413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:50.127868 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:50.129700 24413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } }
I20260811 18:59:50.130296 24413 leader_election.cc:302] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2717f57c183742858c57d6650bbe237a; no voters:
I20260811 18:59:50.131031 24413 leader_election.cc:288] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:50.131152 24423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:50.131819 24423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [term 1 LEADER]: Becoming Leader. State: Replica: 2717f57c183742858c57d6650bbe237a, State: Running, Role: LEADER
I20260811 18:59:50.132717 24423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } }
I20260811 18:59:50.134718 24413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:50.135985 24427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2717f57c183742858c57d6650bbe237a. Latest consensus state: current_term: 1 leader_uuid: "2717f57c183742858c57d6650bbe237a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } } }
I20260811 18:59:50.135955 24432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2717f57c183742858c57d6650bbe237a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2717f57c183742858c57d6650bbe237a" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 37093 } } }
I20260811 18:59:50.136655 24427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:50.136652 24432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:50.144210 24438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:50.152446 24438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:50.154176 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:50.133804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50723 (local address 127.19.155.254:37093)
0811 18:59:50.133994 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:50.134000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:50.134021 (+ 21us) server_negotiation.cc:407] Connection header received
0811 18:59:50.134218 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:50.134223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:50.134349 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:50.134469 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:50.136835 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:50.137986 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:50.140233 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:50.141220 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:50.141359 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:50.145528 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:50.145535 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:50.145540 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:50.145587 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:50.149768 (+ 4181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:50.150670 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:50.150678 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:50.150683 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:50.150893 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:50.151469 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:50.151474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:50.151477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:50.151918 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:50.152214 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:50.153502 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0811 18:59:50.153773 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:59:50.166718 24438 catalog_manager.cc:1347] Generated new cluster ID: 91ac7ff5b61f4a12a2eb4dd7a7037a62
I20260811 18:59:50.166857 24438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:50.183575 24438 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:50.185638 24438 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:50.198277 24438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2717f57c183742858c57d6650bbe237a: Generated new TSK 0
I20260811 18:59:50.199671 24438 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:50.206218 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24303
I20260811 18:59:50.207433 24404 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 18:59:50.302048 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24303
2026-08-11T18:59:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2492 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:50 dist-test-slave-1nl6 krb5kdc[24471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:50 dist-test-slave-1nl6 krb5kdc[24471](info): set up 2 sockets
Aug 11 18:59:50 dist-test-slave-1nl6 krb5kdc[24471](info): commencing operation
krb5kdc: starting...
W20260811 18:59:51.691366 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.003s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:51 dist-test-slave-1nl6 krb5kdc[24471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:52.060235 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44977
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:44977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:52.436590 24488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:52.436942 24488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:52.437044 24488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:52.445374 24488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:52.445536 24488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:52.445596 24488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:52.445662 24488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:52.445708 24488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:52.456321 24488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:44977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:44977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:52.457729 24488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:52.459195 24488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:52.472822 24501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:52.472913 24497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:52.472868 24495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:52.473877 24488 server_base.cc:1034] running on GCE node
I20260811 18:59:52.474877 24488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:52.476738 24488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:52.478045 24488 hybrid_clock.cc:648] HybridClock initialized: now 1786474792477983 us; error 59 us; skew 500 ppm
I20260811 18:59:52.478471 24488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:52 dist-test-slave-1nl6 krb5kdc[24471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474792, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:52.485870 24488 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:52.487854 24488 webserver.cc:460] Webserver started at http://127.19.155.254:41891/ using document root <none> and password file <none>
I20260811 18:59:52.488673 24488 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:52.488850 24488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:52.489199 24488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:52.492657 24488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "f8ea0c9baad342ceb72e03be0ff793a6"
format_stamp: "Formatted at 2026-08-11 18:59:52 on dist-test-slave-1nl6"
server_key: "3c36bc0228ef8bdf5774c6f908fcb507"
server_key_iv: "4de203b7343f37d1ee7022a2beffb4a6"
server_key_version: "encryptionkey@0"
I20260811 18:59:52.493559 24488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "f8ea0c9baad342ceb72e03be0ff793a6"
format_stamp: "Formatted at 2026-08-11 18:59:52 on dist-test-slave-1nl6"
server_key: "3c36bc0228ef8bdf5774c6f908fcb507"
server_key_iv: "4de203b7343f37d1ee7022a2beffb4a6"
server_key_version: "encryptionkey@0"
I20260811 18:59:52.499815 24488 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 18:59:52.503957 24513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:52.505560 24488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 18:59:52.505802 24488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "f8ea0c9baad342ceb72e03be0ff793a6"
format_stamp: "Formatted at 2026-08-11 18:59:52 on dist-test-slave-1nl6"
server_key: "3c36bc0228ef8bdf5774c6f908fcb507"
server_key_iv: "4de203b7343f37d1ee7022a2beffb4a6"
server_key_version: "encryptionkey@0"
I20260811 18:59:52.506043 24488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:52.526865 24488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:52.531580 24488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:52.531919 24488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:52.552538 24488 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:44977
I20260811 18:59:52.552559 24603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:44977 every 8 connection(s)
I20260811 18:59:52.554067 24488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:52.558243 24605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:52.558801 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24488
I20260811 18:59:52.559036 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:52.559614 20079 external_mini_cluster.cc:1428] Setting key 161c962802c5a1f57d5eecd322d69f2d
I20260811 18:59:52.573405 24605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6: Bootstrap starting.
I20260811 18:59:52.575172 24612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:52.561566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44165 (local address 127.19.155.254:44977)
0811 18:59:52.562490 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:52.562503 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:52.562550 (+ 47us) server_negotiation.cc:407] Connection header received
0811 18:59:52.565094 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:52.565123 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:52.565612 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:52.565994 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:52.566628 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:52.568033 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:52.570094 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:52.570961 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:52.571129 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:52.572491 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:52.572499 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:52.572516 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:52.573095 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:52.573239 (+ 144us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:52.573279 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:52.573408 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:52.573722 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 18:59:52.574053 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":456,"threads_started":1}
I20260811 18:59:52.577231 24605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:52.578506 24605 log.cc:824] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:52.579489 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:52.582087 24605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6: No bootstrap required, opened a new log
I20260811 18:59:52.592777 24605 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } }
I20260811 18:59:52.593382 24605 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:52.593529 24605 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8ea0c9baad342ceb72e03be0ff793a6, State: Initialized, Role: FOLLOWER
I20260811 18:59:52.594465 24612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:52.587117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50983 (local address 127.19.155.254:44977)
0811 18:59:52.587352 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:52.587359 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:52.587868 (+ 509us) server_negotiation.cc:407] Connection header received
0811 18:59:52.588049 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:52.588060 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:52.588153 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:52.588288 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:52.588837 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:52.589990 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:52.591570 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:52.592263 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:52.592404 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:52.593626 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:52.593632 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:52.593636 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:52.593656 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:52.593737 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:52.593764 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:52.593869 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:52.594023 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:59:52.594121 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 18:59:52.594286 24605 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } }
I20260811 18:59:52.594678 24605 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:52.594853 24605 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:52.595086 24605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:52.597645 24605 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } }
I20260811 18:59:52.598273 24605 leader_election.cc:302] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8ea0c9baad342ceb72e03be0ff793a6; no voters:
I20260811 18:59:52.598886 24605 leader_election.cc:288] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:52.599121 24624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:52.599951 24624 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [term 1 LEADER]: Becoming Leader. State: Replica: f8ea0c9baad342ceb72e03be0ff793a6, State: Running, Role: LEADER
I20260811 18:59:52.600600 24624 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } }
I20260811 18:59:52.601447 24605 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:52.604328 24627 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8ea0c9baad342ceb72e03be0ff793a6. Latest consensus state: current_term: 1 leader_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } } }
I20260811 18:59:52.604720 24627 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:52.604203 24625 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8ea0c9baad342ceb72e03be0ff793a6" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 44977 } } }
I20260811 18:59:52.605427 24625 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:52.608040 24635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:52.614452 24635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:52.624383 24635 catalog_manager.cc:1347] Generated new cluster ID: 108292c8b3694c7da5816f26163e11e3
I20260811 18:59:52.624544 24635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:52.644357 24635 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:52.646559 24635 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:52.659819 24635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8ea0c9baad342ceb72e03be0ff793a6: Generated new TSK 0
I20260811 18:59:52.661072 24635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:52.675891 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24488
W20260811 18:59:52.677734 24598 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44165
W20260811 18:59:52.678696 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24488: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:52.678869 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24488
2026-08-11T18:59:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:52 dist-test-slave-1nl6 krb5kdc[24665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:52 dist-test-slave-1nl6 krb5kdc[24665](info): set up 2 sockets
Aug 11 18:59:52 dist-test-slave-1nl6 krb5kdc[24665](info): commencing operation
krb5kdc: starting...
W20260811 18:59:54.093427 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.002s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:54 dist-test-slave-1nl6 krb5kdc[24665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:54.490392 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35181
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:35181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:54.877228 24691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:54.877589 24691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:54.877688 24691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:54.885260 24691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:54.885396 24691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:54.885452 24691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:54.885515 24691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:54.885560 24691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:54.895900 24691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:35181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:35181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:54.897305 24691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:54.898664 24691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:54.911437 24696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:54.911368 24697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:54.911471 24705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:54.912353 24691 server_base.cc:1034] running on GCE node
I20260811 18:59:54.913264 24691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:54.914806 24691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:54.916060 24691 hybrid_clock.cc:648] HybridClock initialized: now 1786474794916004 us; error 48 us; skew 500 ppm
I20260811 18:59:54.916464 24691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:54 dist-test-slave-1nl6 krb5kdc[24665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474794, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:54.919939 24691 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:54.921667 24691 webserver.cc:460] Webserver started at http://127.19.155.254:33751/ using document root <none> and password file <none>
I20260811 18:59:54.922459 24691 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:54.922629 24691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:54.923025 24691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:54.926339 24691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "57faa1081db44ec38787ed9c26d82b1e"
format_stamp: "Formatted at 2026-08-11 18:59:54 on dist-test-slave-1nl6"
server_key: "53e9cfdf6a2876a4d4c04558a36e8918"
server_key_iv: "f624ef22557d868afb1f0800c7ac48f7"
server_key_version: "encryptionkey@0"
I20260811 18:59:54.927312 24691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "57faa1081db44ec38787ed9c26d82b1e"
format_stamp: "Formatted at 2026-08-11 18:59:54 on dist-test-slave-1nl6"
server_key: "53e9cfdf6a2876a4d4c04558a36e8918"
server_key_iv: "f624ef22557d868afb1f0800c7ac48f7"
server_key_version: "encryptionkey@0"
I20260811 18:59:54.933406 24691 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260811 18:59:54.937546 24720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:54.939414 24691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 18:59:54.939659 24691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "57faa1081db44ec38787ed9c26d82b1e"
format_stamp: "Formatted at 2026-08-11 18:59:54 on dist-test-slave-1nl6"
server_key: "53e9cfdf6a2876a4d4c04558a36e8918"
server_key_iv: "f624ef22557d868afb1f0800c7ac48f7"
server_key_version: "encryptionkey@0"
I20260811 18:59:54.939904 24691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:54.946256 24691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:54.950637 24691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:54.951105 24691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:54.970372 24691 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:35181
I20260811 18:59:54.970412 24806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:35181 every 8 connection(s)
I20260811 18:59:54.972018 24691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:54.976141 24810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:54.980957 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24691
I20260811 18:59:54.981158 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:54.981606 20079 external_mini_cluster.cc:1428] Setting key 79c3e5f540025c8efeea6f728944a332
I20260811 18:59:54.987934 24810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e: Bootstrap starting.
I20260811 18:59:54.990074 24816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:54.983506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33377 (local address 127.19.155.254:35181)
0811 18:59:54.984445 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:54.984458 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:54.984501 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:59:54.986337 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:54.986363 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:54.986742 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:54.987238 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:54.988346 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:54.988352 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:54.988367 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:54.988389 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:54.988448 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:54.988477 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:54.988743 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:54.988895 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 18:59:54.989095 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":424,"threads_started":1}
I20260811 18:59:54.991725 24810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:54.993209 24810 log.cc:824] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:54.994449 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:54.996382 24810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e: No bootstrap required, opened a new log
I20260811 18:59:55.002059 24816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:54.999199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39587 (local address 127.19.155.254:35181)
0811 18:59:54.999374 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:54.999378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:54.999890 (+ 512us) server_negotiation.cc:407] Connection header received
0811 18:59:55.000109 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:55.000113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:55.000180 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:55.000303 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:55.001344 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:55.001348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:55.001351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:59:55.001371 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:55.001417 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:59:55.001434 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:55.001578 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:55.001701 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:59:55.001775 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:59:55.005895 24810 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } }
I20260811 18:59:55.006441 24810 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:59:55.006608 24810 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57faa1081db44ec38787ed9c26d82b1e, State: Initialized, Role: FOLLOWER
I20260811 18:59:55.007429 24810 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } }
I20260811 18:59:55.007719 24810 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:59:55.007889 24810 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:59:55.008080 24810 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:55.010427 24810 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } }
I20260811 18:59:55.011150 24810 leader_election.cc:302] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57faa1081db44ec38787ed9c26d82b1e; no voters:
I20260811 18:59:55.011859 24810 leader_election.cc:288] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:59:55.011997 24827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:55.013434 24827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [term 1 LEADER]: Becoming Leader. State: Replica: 57faa1081db44ec38787ed9c26d82b1e, State: Running, Role: LEADER
I20260811 18:59:55.014045 24827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } }
I20260811 18:59:55.014559 24810 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:55.017243 24829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57faa1081db44ec38787ed9c26d82b1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } } }
I20260811 18:59:55.017218 24830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57faa1081db44ec38787ed9c26d82b1e. Latest consensus state: current_term: 1 leader_uuid: "57faa1081db44ec38787ed9c26d82b1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57faa1081db44ec38787ed9c26d82b1e" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 35181 } } }
I20260811 18:59:55.017725 24830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:55.017730 24829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:55.019706 24839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:55.026639 24839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:59:55.037248 24839 catalog_manager.cc:1347] Generated new cluster ID: 01051587768a4cbf9883b06962359fe9
I20260811 18:59:55.037393 24839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:55.063189 24839 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:55.063755 24839 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:55.077920 24839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57faa1081db44ec38787ed9c26d82b1e: Generated new TSK 0
I20260811 18:59:55.078960 24839 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:59:55.093631 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24691
W20260811 18:59:55.095557 24799 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33377
W20260811 18:59:55.096385 20079 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24691: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 18:59:55.096549 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24691
2026-08-11T18:59:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2416 ms)
[----------] 18 tests from AuthTokenIssuingTest (43390 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:59:55 dist-test-slave-1nl6 krb5kdc[24863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:59:55 dist-test-slave-1nl6 krb5kdc[24863](info): set up 2 sockets
Aug 11 18:59:55 dist-test-slave-1nl6 krb5kdc[24863](info): commencing operation
krb5kdc: starting...
W20260811 18:59:56.507544 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.359s user 0.004s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 18:59:56 dist-test-slave-1nl6 krb5kdc[24863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:59:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:59:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 18:59:56.924810 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46241
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:59:57.310572 24891 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:59:57.311031 24891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:57.311122 24891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:57.311201 24891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:57.319123 24891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:57.319243 24891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:57.319305 24891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:57.319350 24891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:57.319418 24891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:57.331633 24891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:46241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:57.333040 24891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:57.334565 24891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:57.347932 24903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:57.348230 24906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:57.348502 24904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:57.348759 24891 server_base.cc:1034] running on GCE node
I20260811 18:59:57.349727 24891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:57.351500 24891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:57.352777 24891 hybrid_clock.cc:648] HybridClock initialized: now 1786474797352694 us; error 55 us; skew 500 ppm
I20260811 18:59:57.353183 24891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:57 dist-test-slave-1nl6 krb5kdc[24863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:57.356909 24891 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 18:59:57.358702 24891 webserver.cc:460] Webserver started at http://127.19.155.254:39429/ using document root <none> and password file <none>
I20260811 18:59:57.359575 24891 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:57.359724 24891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:57.360097 24891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:57.363560 24891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "80a46932157a4f67961ac280812e2460"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "2d506196c21a96fc996d282185b9d849"
server_key_iv: "5c4ccbcd47d8019b03112669a909a5ac"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.364486 24891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "80a46932157a4f67961ac280812e2460"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "2d506196c21a96fc996d282185b9d849"
server_key_iv: "5c4ccbcd47d8019b03112669a909a5ac"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.370286 24891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 18:59:57.374475 24917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:57.376077 24891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 18:59:57.376308 24891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "80a46932157a4f67961ac280812e2460"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "2d506196c21a96fc996d282185b9d849"
server_key_iv: "5c4ccbcd47d8019b03112669a909a5ac"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.376569 24891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:57.404955 24891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:57.409983 24891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:57.410352 24891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:57.430867 24891 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:46241
I20260811 18:59:57.430888 25002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:46241 every 8 connection(s)
I20260811 18:59:57.432562 24891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 18:59:57.435765 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 24891
I20260811 18:59:57.436007 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 18:59:57.436902 20079 external_mini_cluster.cc:1428] Setting key 077a4bbce830bcd6b347020baf93f263
I20260811 18:59:57.437098 25004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:57.444275 25004 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:57 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:57.468820 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.447801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40780 (local address 127.19.155.254:46241)
0811 18:59:57.449554 (+ 1753us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:57.449563 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:57.449621 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:59:57.451307 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:57.451313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:57.451555 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:57.451766 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:57.453195 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:57.454437 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:57.455939 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:57.456524 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:57.456867 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:57.460911 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:57.460922 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:57.460938 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:57.460972 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:57.464000 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:57.464802 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:57.464809 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:57.464812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:57.464973 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:57.465422 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:57.465434 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:57.465437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:57.466005 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:57.466237 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:57.466788 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 18:59:57.467236 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":1531,"thread_start_us":1292,"threads_started":1}
I20260811 18:59:57.468840 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.447800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46241 (local address 127.0.0.1:40780)
0811 18:59:57.448703 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.448761 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:57.450846 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:57.451805 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:57.451812 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:57.452606 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:57.452963 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:57.452981 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:57.454609 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:57.454617 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:57.455789 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:57.455803 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:57.456897 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:57.456907 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:57.457092 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:57.457864 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:57.457890 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:57.460634 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:57.464174 (+ 3540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:57.464186 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:57.464201 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:57.464639 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:57.465095 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:57.465103 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:57.465108 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:57.465292 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:57.466150 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:57.466164 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:57.466389 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 18:59:57.466647 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 18:59:57.467385 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":167,"thread_start_us":374,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.253@KRBTEST.COM; defaulting to no policy
I20260811 18:59:57.472653 25004 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:59:57.473917 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.473406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34888)
0811 18:59:57.473614 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.473747 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.253@KRBTEST.COM" created.
W20260811 18:59:57.474221 24922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
I20260811 18:59:57.476186 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.475620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34902)
0811 18:59:57.475842 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.475951 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 18:59:57.476429 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:35319: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
I20260811 18:59:57.514694 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:35319
--webserver_interface=127.19.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:59:57.525878 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } attempt: 1
I20260811 18:59:57.527343 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.526700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34910)
0811 18:59:57.526990 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.527151 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 18:59:57.528626 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.528133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34912)
0811 18:59:57.528332 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.528433 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 18:59:57.528851 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:35319: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
I20260811 18:59:57.597131 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } attempt: 2
I20260811 18:59:57.598395 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.597879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34920)
0811 18:59:57.598153 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.598250 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:59:57.599655 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.599248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34930)
0811 18:59:57.599446 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.599519 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 18:59:57.599866 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:35319: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
I20260811 18:59:57.691143 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } attempt: 3
I20260811 18:59:57.692351 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.691882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34946)
0811 18:59:57.692100 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.692211 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 18:59:57.693617 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.693168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34956)
0811 18:59:57.693360 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.693451 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 18:59:57.693861 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:35319: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
I20260811 18:59:57.837182 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } attempt: 4
I20260811 18:59:57.838598 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.838010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34958)
0811 18:59:57.838363 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.838457 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185}
I20260811 18:59:57.839766 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:57.839372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34966)
0811 18:59:57.839541 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:57.839628 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:59:57.839957 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:35319: Network error: Client connection negotiation failed: client connection to 127.19.155.253:35319: connect: Connection refused (error 111)
W20260811 18:59:57.892256 25014 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:59:57.892688 25014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:57.892819 25014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:57.892964 25014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:57.900599 25014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:57.900753 25014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:57.900866 25014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:57.900955 25014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:57.901050 25014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:57.911805 25014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:35319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:57.913362 25014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:57.914845 25014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:57.927897 25023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:57.927868 25022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:57.928017 25025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:57.928833 25014 server_base.cc:1034] running on GCE node
I20260811 18:59:57.929765 25014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:57.931432 25014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:57.932704 25014 hybrid_clock.cc:648] HybridClock initialized: now 1786474797932636 us; error 50 us; skew 500 ppm
I20260811 18:59:57.933079 25014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:57 dist-test-slave-1nl6 krb5kdc[24863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:57.939997 25014 init.cc:377] Logged in from keytab as kudu/127.19.155.253@KRBTEST.COM (short username kudu)
I20260811 18:59:57.941689 25014 webserver.cc:460] Webserver started at http://127.19.155.253:45151/ using document root <none> and password file <none>
I20260811 18:59:57.942458 25014 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:57.942562 25014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:57.943041 25014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:57.946269 25014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data/instance:
uuid: "42477a2a840d445790b7a5e046820c8b"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "08977b53992f006a7f06632adfab8655"
server_key_iv: "ac396b0f46b00be642bc6b10b1f4ddf0"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.947273 25014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal/instance:
uuid: "42477a2a840d445790b7a5e046820c8b"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "08977b53992f006a7f06632adfab8655"
server_key_iv: "ac396b0f46b00be642bc6b10b1f4ddf0"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.952867 25014 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 18:59:57.956640 25039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:57.958081 25014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:59:57.958304 25014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "42477a2a840d445790b7a5e046820c8b"
format_stamp: "Formatted at 2026-08-11 18:59:57 on dist-test-slave-1nl6"
server_key: "08977b53992f006a7f06632adfab8655"
server_key_iv: "ac396b0f46b00be642bc6b10b1f4ddf0"
server_key_version: "encryptionkey@0"
I20260811 18:59:57.958565 25014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:57.978847 25014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:57.983973 25014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:57.984292 25014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:58.004593 25014 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.253:35319
I20260811 18:59:58.004616 25119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.253:35319 every 8 connection(s)
I20260811 18:59:58.006063 25014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
I20260811 18:59:58.010245 25120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:58.013671 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25014
I20260811 18:59:58.013891 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-1/wal/instance
I20260811 18:59:58.014358 20079 external_mini_cluster.cc:1428] Setting key 22bd5179b3052a40552c4900f581ac7f
I20260811 18:59:58.017854 25120 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.155.252@KRBTEST.COM; defaulting to no policy
I20260811 18:59:58.054059 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.020942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.19.155.254:46241)
0811 18:59:58.021531 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.021537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.033033 (+ 11496us) server_negotiation.cc:407] Connection header received
0811 18:59:58.035878 (+ 2845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.035888 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.036017 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.036228 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.038044 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.039318 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.041023 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.041786 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.041951 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.045836 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.045848 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.045856 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.045938 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.050160 (+ 4222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.051226 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.051233 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.051240 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.051426 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.051903 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.051908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.051912 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.052359 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.052549 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.053341 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.053631 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":309,"threads_started":1}
I20260811 18:59:58.055015 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.021606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46241 (local address 127.0.0.1:40786)
0811 18:59:58.032779 (+ 11173us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.032860 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.035297 (+ 2437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.036471 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.036480 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.037086 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.037757 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.037778 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.039525 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.039530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.040841 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.040855 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.042024 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.042028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.042251 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.043091 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.043116 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.045532 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.050407 (+ 4875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.050417 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.050434 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.051066 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.051556 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.051559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.051562 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.051766 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.052498 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.052505 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.052912 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.053151 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.053687 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10715,"thread_start_us":10432,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.252@KRBTEST.COM" created.
I20260811 18:59:58.057049 25120 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:59:58.075489 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.058309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34978 (local address 127.19.155.253:35319)
0811 18:59:58.059104 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.059110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.059140 (+ 30us) server_negotiation.cc:407] Connection header received
0811 18:59:58.059193 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.059199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.059406 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.059576 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.060528 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.061729 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.063067 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.063692 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.063870 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.067612 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.067646 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.067674 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.067735 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.072167 (+ 4432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.072972 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.072985 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.072991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.073169 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.073724 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.073727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.073729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.074124 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.074316 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.074764 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.075161 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":165,"server-negotiator.queue_time_us":613,"thread_start_us":421,"threads_started":1}
I20260811 18:59:58.075534 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.058002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34978)
0811 18:59:58.058215 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.058233 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.058342 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.059567 (+ 1225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.059571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.060088 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.060250 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.060260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.061888 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.061895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.062876 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.062890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.063853 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.063859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.064054 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.064742 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.064762 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.067325 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.072381 (+ 5056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.072386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.072389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.072812 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.073370 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.073377 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.073382 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.073582 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.074271 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.074277 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.074460 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.074643 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.075028 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 18:59:58.078284 25120 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:59:58.079769 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.079165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53238)
0811 18:59:58.079380 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.079540 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 18:59:58.080157 25049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.082213 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.081711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53250)
0811 18:59:58.081922 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.082032 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:59:58.082479 25120 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
I20260811 18:59:58.102015 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:41743
--webserver_interface=127.19.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:35221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:59:58.131872 25120 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 1
I20260811 18:59:58.133337 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.132615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53254)
0811 18:59:58.132908 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.133073 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 18:59:58.134749 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.134231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53262)
0811 18:59:58.134450 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.134570 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:59:58.135021 25120 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.139266 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } attempt: 5
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:59:58.155085 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.140357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.19.155.253:35319)
0811 18:59:58.140638 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.140646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.141263 (+ 617us) server_negotiation.cc:407] Connection header received
0811 18:59:58.141340 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.141344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.141407 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.141520 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.142614 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.143858 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.145334 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.145800 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.145946 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.149388 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.149393 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.149397 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.149433 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.152214 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.152950 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.152958 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.152966 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.153102 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.153573 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.153583 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.153586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.153891 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.154053 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.154457 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.154701 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 18:59:58.155095 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.140684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34982)
0811 18:59:58.140968 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.140990 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.141140 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.141556 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.141560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.142191 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.142452 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.142464 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.144045 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.144052 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.145133 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.145146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.145965 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.145972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.146216 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.146959 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.146991 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.149146 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.152395 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.152401 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.152405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.152815 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.153226 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.153231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.153235 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.153383 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.154017 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.154022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.154184 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.154339 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.154691 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 18:59:58.156544 25004 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:59:58.157729 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.157316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53276)
0811 18:59:58.157503 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.157591 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:59:58.158738 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.158397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53284)
0811 18:59:58.158554 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.158630 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 18:59:58.158995 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.203280 25120 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 2
I20260811 18:59:58.204632 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.204043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53288)
0811 18:59:58.204309 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.204423 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 18:59:58.205713 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.205331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53300)
0811 18:59:58.205489 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.205575 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 18:59:58.205955 25120 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.210244 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 1
I20260811 18:59:58.211719 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.211048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53316)
0811 18:59:58.211335 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.211472 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 18:59:58.213006 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.212575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53320)
0811 18:59:58.212747 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.212845 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 18:59:58.213254 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.281569 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 2
I20260811 18:59:58.282953 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.282325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53324)
0811 18:59:58.282569 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.282688 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 18:59:58.284201 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.283744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53338)
0811 18:59:58.283926 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.284044 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:59:58.284443 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.297219 25120 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 3
I20260811 18:59:58.298764 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.298049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53354)
0811 18:59:58.298352 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.298497 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 18:59:58.300336 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.299688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53370)
0811 18:59:58.299994 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.300117 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
W20260811 18:59:58.300650 25120 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.390734 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 3
I20260811 18:59:58.392212 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.391589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53376)
0811 18:59:58.391848 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.391966 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 18:59:58.393352 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.392931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53386)
0811 18:59:58.393153 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.393238 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260811 18:59:58.393674 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.443908 25120 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 4
I20260811 18:59:58.445192 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.444653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53392)
0811 18:59:58.444936 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.445028 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 18:59:58.446430 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.446060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53402)
0811 18:59:58.446231 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.446304 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 18:59:58.446713 25120 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
W20260811 18:59:58.490833 25136 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:59:58.491377 25136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:59:58.491513 25136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:59:58.491659 25136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:59:58.499382 25136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:59:58.499524 25136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:59:58.499631 25136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:59:58.499725 25136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:59:58.499842 25136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:59:58.510277 25136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:35221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:46241,127.19.155.253:35319,127.19.155.252:41743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:41743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 18:59:58.511845 25136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:59:58.513396 25136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:59:58.526026 25147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:58.525956 25151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:59:58.526021 25148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:59:58.527069 25136 server_base.cc:1034] running on GCE node
I20260811 18:59:58.527884 25136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:59:58.529348 25136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:59:58.530587 25136 hybrid_clock.cc:648] HybridClock initialized: now 1786474798530520 us; error 30 us; skew 500 ppm
I20260811 18:59:58.531050 25136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474798, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:59:58.534651 25136 init.cc:377] Logged in from keytab as kudu/127.19.155.252@KRBTEST.COM (short username kudu)
I20260811 18:59:58.536437 25136 webserver.cc:460] Webserver started at http://127.19.155.252:42971/ using document root <none> and password file <none>
I20260811 18:59:58.537225 25136 fs_manager.cc:359] Metadata directory not provided
I20260811 18:59:58.537372 25136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:59:58.537740 25136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:59:58.541122 25136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data/instance:
uuid: "9de6f4007049477eb621ddb55dcebbe6"
format_stamp: "Formatted at 2026-08-11 18:59:58 on dist-test-slave-1nl6"
server_key: "42bb88f26f042674b36440d5466e14d6"
server_key_iv: "bb2457fea8948aff6d81cdb5e2a38445"
server_key_version: "encryptionkey@0"
I20260811 18:59:58.542074 25136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal/instance:
uuid: "9de6f4007049477eb621ddb55dcebbe6"
format_stamp: "Formatted at 2026-08-11 18:59:58 on dist-test-slave-1nl6"
server_key: "42bb88f26f042674b36440d5466e14d6"
server_key_iv: "bb2457fea8948aff6d81cdb5e2a38445"
server_key_version: "encryptionkey@0"
I20260811 18:59:58.548151 25136 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 18:59:58.552188 25160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:59:58.553766 25136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 18:59:58.554003 25136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "9de6f4007049477eb621ddb55dcebbe6"
format_stamp: "Formatted at 2026-08-11 18:59:58 on dist-test-slave-1nl6"
server_key: "42bb88f26f042674b36440d5466e14d6"
server_key_iv: "bb2457fea8948aff6d81cdb5e2a38445"
server_key_version: "encryptionkey@0"
I20260811 18:59:58.554275 25136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:59:58.570999 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 4
I20260811 18:59:58.572281 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.571785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53418)
0811 18:59:58.572012 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.572107 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 18:59:58.573359 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.572996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53424)
0811 18:59:58.573165 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.573238 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 18:59:58.573598 25004 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:41743: Network error: Client connection negotiation failed: client connection to 127.19.155.252:41743: connect: Connection refused (error 111)
I20260811 18:59:58.579383 25136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:59:58.584594 25136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:59:58.584924 25136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:59:58.607113 25136 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.252:41743
I20260811 18:59:58.607120 25252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.252:41743 every 8 connection(s)
I20260811 18:59:58.608675 25136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
I20260811 18:59:58.610334 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25136
I20260811 18:59:58.610540 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474422014372-20079-0/minicluster-data/master-2/wal/instance
I20260811 18:59:58.611122 20079 external_mini_cluster.cc:1428] Setting key 6891a2d8452e0c5e994e6aff6c443efc
I20260811 18:59:58.613816 25254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:59:58.622822 25254 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474798, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 18:59:58.636739 25258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.613271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53432 (local address 127.19.155.252:41743)
0811 18:59:58.614126 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.614141 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.614186 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:59:58.616111 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.616141 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.616732 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.617088 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.619061 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.620433 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.622268 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.623036 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.623190 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.628442 (+ 5252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.628450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.628465 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.628509 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.631776 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.632588 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.632595 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.632602 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.632864 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.633304 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.633309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.633316 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.633912 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.634240 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.634757 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.635254 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":381,"threads_started":1}
I20260811 18:59:58.642045 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.626318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40788 (local address 127.19.155.254:46241)
0811 18:59:58.626889 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.626922 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.627476 (+ 554us) server_negotiation.cc:407] Connection header received
0811 18:59:58.627716 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.627720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.627795 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.627922 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.629177 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.629933 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.631601 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.632005 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.632183 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.635616 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.635623 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.635627 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.635686 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.638763 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.639687 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.639692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.639694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.639907 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.640420 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.640427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.640430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.640898 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.641066 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.641571 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.641742 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":264,"threads_started":1}
I20260811 18:59:58.642313 25262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.626296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:46241 (local address 127.0.0.1:40788)
0811 18:59:58.627308 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.627358 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.627569 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.627991 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.627998 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.628703 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.629016 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.629026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.630096 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.630102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.631392 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.631405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.632219 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.632225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.632411 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.633011 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.633037 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.635395 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.638950 (+ 3555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.638968 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.638975 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.639537 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.640084 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.640089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.640094 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.640281 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.641039 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.641046 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.641241 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.641456 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.641840 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":595,"threads_started":1}
I20260811 18:59:58.644037 25254 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474798, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:59:58.657905 25263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.640242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.19.155.254:46241)
0811 18:59:58.641015 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.641020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.641043 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:58.641091 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.641096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.641164 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.641246 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.642947 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.644004 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.645474 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.646012 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.646108 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.650843 (+ 4735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.650849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.650853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.650890 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.654774 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.655517 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.655526 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.655530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.655701 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.656196 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.656199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.656201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.656568 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.656848 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.657263 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.657509 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":370,"threads_started":1}
I20260811 18:59:58.658668 25262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.644881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:35319 (local address 127.0.0.1:34988)
0811 18:59:58.645052 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.645073 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.645175 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.645702 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.645705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.646100 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.646306 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.646319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.647414 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.647419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.648302 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.648313 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.649038 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.649044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.649242 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.649907 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.649931 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.652161 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.655831 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.655836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.655840 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.656359 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.656807 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.656812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.656815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.656995 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.657699 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.657704 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.657863 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.658014 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.658356 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 18:59:58.659449 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.644906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34988 (local address 127.19.155.253:35319)
0811 18:59:58.645358 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.645362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.645376 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:59:58.645455 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.645460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.645533 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.645627 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.646475 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.647241 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.648462 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.648884 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.649018 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.652382 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.652389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.652394 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.652439 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.655620 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.656484 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.656489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.656493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.656678 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.657151 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.657156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.657159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.657518 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.657685 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.658609 (+ 924us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.659101 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337}
I20260811 18:59:58.660554 25254 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474798, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 18:59:58.676635 25258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.661340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.19.155.252:41743)
0811 18:59:58.661542 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.661550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.661770 (+ 220us) server_negotiation.cc:407] Connection header received
0811 18:59:58.661915 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.661919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.661975 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.662052 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.662875 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.663936 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.665544 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.666223 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.666356 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.670275 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.670280 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.670283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.670310 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.673845 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.674500 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.674507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.674512 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.674660 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.675141 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.675145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.675147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.675433 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.675613 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.675975 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.676230 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 18:59:58.676751 25262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.661334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53448)
0811 18:59:58.661673 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.661692 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.661806 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.662115 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.662119 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.662599 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.662741 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.662749 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.664055 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.664061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.665407 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.665424 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.666405 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.666411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.666634 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.667443 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.667469 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.670073 (+ 2604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.673989 (+ 3916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.673993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.673995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.674376 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.674807 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.674812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.674815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.675024 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.675581 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.675584 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.675715 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.675886 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.676416 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":171}
I20260811 18:59:58.677798 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.659925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34994 (local address 127.19.155.253:35319)
0811 18:59:58.660275 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.660281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.660300 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:59:58.660354 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.660358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.660431 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.660530 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.662487 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.663719 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.665544 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.666239 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.666356 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.671326 (+ 4970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.671333 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.671338 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.671384 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.674699 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.675513 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.675520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.675524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.675720 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.676159 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.676165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.676168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.676512 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.676801 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.677217 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.677472 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":638,"threads_started":1}
I20260811 18:59:58.683017 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:59:58.683357 25254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: Bootstrap starting.
I20260811 18:59:58.687417 25254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:58.688508 25254 log.cc:824] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:58.686551 24959 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "80a46932157a4f67961ac280812e2460"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40792
I20260811 18:59:58.691429 25254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: No bootstrap required, opened a new log
I20260811 18:59:58.702636 25254 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.703223 25254 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de6f4007049477eb621ddb55dcebbe6, State: Initialized, Role: FOLLOWER
I20260811 18:59:58.703785 25254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.704839 25267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:58.705238 25267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:58.706218 25254 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:59:58.716269 25285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:59:58.716413 25285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:59:58.713969 25136 master_runner.cc:186] Error getting master registration for 127.19.155.254:46241: OK, instance_id { permanent_uuid: "80a46932157a4f67961ac280812e2460" instance_seqno: 1786474797425125 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:59:58.725606 25136 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:59:58.745966 25120 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 5
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 18:59:58.760959 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.746732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53456)
0811 18:59:58.746969 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.746991 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.747127 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.747485 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.747493 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.747948 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.748109 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.748119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.749203 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.749209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.750139 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.750152 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.751022 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.751028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.751266 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.751947 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.751966 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.754145 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.757992 (+ 3847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.757997 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.758001 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.758585 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.759057 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.759062 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.759065 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.759254 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.759850 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.759854 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.760067 (+ 213us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.760224 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.760553 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 18:59:58.760967 25258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.746839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.19.155.252:41743)
0811 18:59:58.747146 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.747151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.747174 (+ 23us) server_negotiation.cc:407] Connection header received
0811 18:59:58.747244 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.747249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.747327 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.747432 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.748283 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.749048 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.750298 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.750814 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.750988 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.754361 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.754366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.754370 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.754409 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.757821 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.758720 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.758727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.758731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.758890 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.759355 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.759362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.759366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.759711 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.759889 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.760356 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.760581 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 18:59:58.766453 25120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: Bootstrap starting.
I20260811 18:59:58.769836 25120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:58.770968 25120 log.cc:824] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:58.773823 25120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: No bootstrap required, opened a new log
I20260811 18:59:58.781668 25120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.782021 25120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42477a2a840d445790b7a5e046820c8b, State: Initialized, Role: FOLLOWER
I20260811 18:59:58.782496 25120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.783752 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:58.784202 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:58.784965 25120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: configured and running, proceeding with master startup.
W20260811 18:59:58.802181 25309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:59:58.802479 25309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:59:58.793557 25014 master_runner.cc:186] Error getting master registration for 127.19.155.254:46241: OK, instance_id { permanent_uuid: "80a46932157a4f67961ac280812e2460" instance_seqno: 1786474797425125 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:59:58.805444 25014 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 18:59:58.837283 25171 tablet.cc:2369] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:58.850885 25004 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } attempt: 5
Aug 11 18:59:58 dist-test-slave-1nl6 krb5kdc[24863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474797, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 18:59:58.867959 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.851762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:41743 (local address 127.0.0.1:53464)
0811 18:59:58.852041 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 18:59:58.852059 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:59:58.852185 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:59:58.852695 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:59:58.852702 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:59:58.853275 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:59:58.853514 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.853527 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.854622 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.854629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.856323 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:59:58.856349 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.857136 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.857142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:59:58.857360 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.858134 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:59:58.858161 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:59:58.861076 (+ 2915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:59:58.864995 (+ 3919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.865002 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.865007 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.865580 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.866015 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:59:58.866023 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:59:58.866028 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:59:58.866216 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:59:58.866781 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:59:58.866786 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:59:58.867010 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 18:59:58.867173 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 18:59:58.867505 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260811 18:59:58.867944 25258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.851815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53464 (local address 127.19.155.252:41743)
0811 18:59:58.852376 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.852381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.852396 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:59:58.852452 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.852455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.852516 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.852650 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.853708 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.854469 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.856489 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.856968 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.857118 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.861291 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.861297 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.861300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.861336 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.864796 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.865706 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.865712 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.865716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.865887 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.866328 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.866333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.866337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.866641 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.866820 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.867291 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.867545 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451}
I20260811 18:59:58.874557 25004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: Bootstrap starting.
I20260811 18:59:58.878991 25004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: Neither blocks nor log segments found. Creating new log.
I20260811 18:59:58.880437 25004 log.cc:824] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: Log is configured to *not* fsync() on all Append() calls
I20260811 18:59:58.884397 25004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: No bootstrap required, opened a new log
I20260811 18:59:58.892961 25004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.893473 25004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a46932157a4f67961ac280812e2460, State: Initialized, Role: FOLLOWER
I20260811 18:59:58.894060 25004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.895454 25312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:58.896226 25312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:58.896929 25004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:59:58.897044 24959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 18:59:58.897257 24959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:58.901705 24959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.904593 24959 leader_election.cc:288] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [CANDIDATE]: Term 1 election: Requested vote from peers 42477a2a840d445790b7a5e046820c8b (127.19.155.253:35319), 9de6f4007049477eb621ddb55dcebbe6 (127.19.155.252:41743)
I20260811 18:59:58.905050 25082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80a46932157a4f67961ac280812e2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "42477a2a840d445790b7a5e046820c8b"
I20260811 18:59:58.905622 25082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:59:58.908829 25082 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80a46932157a4f67961ac280812e2460 in term 1.
I20260811 18:59:58.909727 24922 leader_election.cc:302] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42477a2a840d445790b7a5e046820c8b, 80a46932157a4f67961ac280812e2460; no voters:
I20260811 18:59:58.910475 25312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:59:58.910259 25204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80a46932157a4f67961ac280812e2460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9de6f4007049477eb621ddb55dcebbe6"
I20260811 18:59:58.910864 25204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 18:59:58.913885 24932 tablet.cc:2369] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:58.917759 25312 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [term 1 LEADER]: Becoming Leader. State: Replica: 80a46932157a4f67961ac280812e2460, State: Running, Role: LEADER
I20260811 18:59:58.918517 25312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } }
I20260811 18:59:58.919565 25204 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80a46932157a4f67961ac280812e2460 in term 1.
I20260811 18:59:58.939944 25314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a46932157a4f67961ac280812e2460. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:58.940510 25314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:58.953888 25326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:59:58.983426 25326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 18:59:58.987243 25051 tablet.cc:2369] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:59:58.988302 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.946011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.19.155.253:35319)
0811 18:59:58.946278 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.946288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.948643 (+ 2355us) server_negotiation.cc:407] Connection header received
0811 18:59:58.948881 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.948889 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.949008 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.949124 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.956885 (+ 7761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.958087 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.960491 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.961255 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.961399 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.967400 (+ 6001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.967409 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.967414 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.967463 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.971578 (+ 4115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.983730 (+ 12152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.983740 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.983745 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.983997 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.984702 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.984713 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.984719 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.985215 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.985531 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:58.987504 (+ 1973us) server_negotiation.cc:299] Negotiation successful
0811 18:59:58.987843 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 18:59:59.005923 25263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.947359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.19.155.254:46241)
0811 18:59:58.947564 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.947571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.955022 (+ 7451us) server_negotiation.cc:407] Connection header received
0811 18:59:58.957062 (+ 2040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.957067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.957154 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.957235 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.966284 (+ 9049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.967640 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.974339 (+ 6699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.975156 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.975298 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.986192 (+ 10894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.986200 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.986205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.986246 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:58.990248 (+ 4002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.995061 (+ 4813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.995069 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.995073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.995280 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:58.996651 (+ 1371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:58.996658 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:58.996662 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:58.997142 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:58.997488 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.004920 (+ 7432us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.005371 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:59:59.018342 25258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:58.949747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.19.155.252:41743)
0811 18:59:58.949976 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:58.949985 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:58.962867 (+ 12882us) server_negotiation.cc:407] Connection header received
0811 18:59:58.963433 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:58.963442 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:58.963567 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:58.963655 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:58.969827 (+ 6172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.970956 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.979322 (+ 8366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:58.980159 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:58.980286 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:58.998489 (+ 18203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:59:58.998497 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:59:58.998503 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:59:58.998556 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:59:59.003408 (+ 4852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:59.010264 (+ 6856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:59.010277 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:59.010281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:59.010496 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:59:59.015248 (+ 4752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:59:59.015257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:59:59.015262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:59:59.015810 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:59:59.016228 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.017538 (+ 1310us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.017886 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:59:59.032655 25204 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [term 1 FOLLOWER]: Refusing update from remote peer 80a46932157a4f67961ac280812e2460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:59.034379 25082 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [term 1 FOLLOWER]: Refusing update from remote peer 80a46932157a4f67961ac280812e2460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:59:59.035750 25312 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:59.037818 25312 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:59:59.081561 25267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a46932157a4f67961ac280812e2460. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.082005 25267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:59.086447 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a46932157a4f67961ac280812e2460. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.086800 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:59.100322 25344 mvcc.cc:205] Tried to move back new op lower bound from 7317400776761327616 to 7317400776378208256. Current Snapshot: MvccSnapshot[applied={T|T < 7317400776761327616}]
I20260811 18:59:59.109181 25312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.110706 25326 catalog_manager.cc:1347] Generated new cluster ID: 5d57330e903847d8abdd96d5cda380a5
I20260811 18:59:59.110954 25326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:59:59.115128 25312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:59.125521 25267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.125845 25267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:59.130075 25352 mvcc.cc:205] Tried to move back new op lower bound from 7317400776761327616 to 7317400776378208256. Current Snapshot: MvccSnapshot[applied={T|T < 7317400776761327616}]
I20260811 18:59:59.137687 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.138015 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:59:59.144423 25312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80a46932157a4f67961ac280812e2460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80a46932157a4f67961ac280812e2460" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 46241 } } peers { permanent_uuid: "42477a2a840d445790b7a5e046820c8b" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 35319 } } peers { permanent_uuid: "9de6f4007049477eb621ddb55dcebbe6" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 41743 } } }
I20260811 18:59:59.144866 25312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460 [sys.catalog]: This master's current role is: LEADER
I20260811 18:59:59.162848 25353 mvcc.cc:205] Tried to move back new op lower bound from 7317400776761327616 to 7317400776378208256. Current Snapshot: MvccSnapshot[applied={T|T < 7317400776761327616 or (T in {7317400776761327616})}]
I20260811 18:59:59.193620 25326 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:59:59.195711 25326 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:59:59.228267 25326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80a46932157a4f67961ac280812e2460: Generated new TSK 0
I20260811 18:59:59.229549 25326 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:59:59.352412 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.339760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35006 (local address 127.19.155.253:35319)
0811 18:59:59.340156 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.340162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.350105 (+ 9943us) server_negotiation.cc:407] Connection header received
0811 18:59:59.350631 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.350638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.350727 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.350816 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.352121 (+ 1305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35006: BlockingRecv error: recv got EOF from 127.0.0.1:35006 (error 108)
Metrics: {"server-negotiator.queue_time_us":237}
W20260811 18:59:59.355268 25263 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.339563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40806 (local address 127.19.155.254:46241)
0811 18:59:59.339964 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.339971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.353455 (+ 13484us) server_negotiation.cc:407] Connection header received
0811 18:59:59.353720 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.353726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.353808 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.353877 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.354987 (+ 1110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40806: BlockingRecv error: recv got EOF from 127.0.0.1:40806 (error 108)
Metrics: {"server-negotiator.queue_time_us":264}
W20260811 18:59:59.358294 25258 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.346526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53480 (local address 127.19.155.252:41743)
0811 18:59:59.346778 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.346788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.356240 (+ 9452us) server_negotiation.cc:407] Connection header received
0811 18:59:59.356722 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.356728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.356815 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.356885 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.358043 (+ 1158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53480: BlockingRecv error: recv got EOF from 127.0.0.1:53480 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 18:59:59.366501 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.363943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35018 (local address 127.19.155.253:35319)
0811 18:59:59.364146 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.364152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.364680 (+ 528us) server_negotiation.cc:407] Connection header received
0811 18:59:59.364959 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.364966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.365115 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.365238 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.366188 (+ 950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35018: BlockingRecv error: recv got EOF from 127.0.0.1:35018 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:59:59.375806 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.373290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35032 (local address 127.19.155.253:35319)
0811 18:59:59.373491 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.373497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.374103 (+ 606us) server_negotiation.cc:407] Connection header received
0811 18:59:59.374333 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.374339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.374432 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.374542 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.375547 (+ 1005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35032: BlockingRecv error: recv got EOF from 127.0.0.1:35032 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 18:59:59.399080 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.396235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35036 (local address 127.19.155.253:35319)
0811 18:59:59.396444 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.396452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.397147 (+ 695us) server_negotiation.cc:407] Connection header received
0811 18:59:59.397378 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.397384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.397475 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.397585 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.398673 (+ 1088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35036: BlockingRecv error: recv got EOF from 127.0.0.1:35036 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 18:59:59.409583 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.407063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.19.155.253:35319)
0811 18:59:59.407322 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.407329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.407941 (+ 612us) server_negotiation.cc:407] Connection header received
0811 18:59:59.408172 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.408177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.408269 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.408374 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.409312 (+ 938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35048: BlockingRecv error: recv got EOF from 127.0.0.1:35048 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 18:59:59.423733 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.421550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.19.155.253:35319)
0811 18:59:59.421780 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.421786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.422145 (+ 359us) server_negotiation.cc:407] Connection header received
0811 18:59:59.422366 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.422370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.422443 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.422531 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.423473 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35060: BlockingRecv error: recv got EOF from 127.0.0.1:35060 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 18:59:59.446228 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.443806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35076 (local address 127.19.155.253:35319)
0811 18:59:59.444006 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.444013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.444575 (+ 562us) server_negotiation.cc:407] Connection header received
0811 18:59:59.444810 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.444816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.444920 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.445024 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.445993 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35076: BlockingRecv error: recv got EOF from 127.0.0.1:35076 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 18:59:59.484797 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.482512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35082 (local address 127.19.155.253:35319)
0811 18:59:59.482737 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.482745 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.483188 (+ 443us) server_negotiation.cc:407] Connection header received
0811 18:59:59.483380 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.483387 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.483505 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.483639 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.484502 (+ 863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35082: BlockingRecv error: recv got EOF from 127.0.0.1:35082 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 18:59:59.556612 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.553508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.19.155.253:35319)
0811 18:59:59.553738 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.553745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.554126 (+ 381us) server_negotiation.cc:407] Connection header received
0811 18:59:59.554319 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.554324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.554420 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.554540 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.556344 (+ 1804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35084: BlockingRecv error: recv got EOF from 127.0.0.1:35084 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 18:59:59.689335 25132 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:59:59.687333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35094 (local address 127.19.155.253:35319)
0811 18:59:59.687609 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.687617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.687907 (+ 290us) server_negotiation.cc:407] Connection header received
0811 18:59:59.688069 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.688073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.688172 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.688259 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:59:59.689106 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35094: BlockingRecv error: recv got EOF from 127.0.0.1:35094 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 18:59:59.718487 25285 catalog_manager.cc:1259] Loaded cluster ID: 5d57330e903847d8abdd96d5cda380a5
I20260811 18:59:59.718600 25285 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: loading cluster ID for follower catalog manager: success
I20260811 18:59:59.721160 25285 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: acquiring CA information for follower catalog manager: success
I20260811 18:59:59.723291 25285 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9de6f4007049477eb621ddb55dcebbe6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:59:59.804854 25309 catalog_manager.cc:1259] Loaded cluster ID: 5d57330e903847d8abdd96d5cda380a5
I20260811 18:59:59.804989 25309 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: loading cluster ID for follower catalog manager: success
I20260811 18:59:59.807960 25309 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: acquiring CA information for follower catalog manager: success
I20260811 18:59:59.809834 25309 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 42477a2a840d445790b7a5e046820c8b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:59:59.955286 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:59.949260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35104 (local address 127.19.155.253:35319)
0811 18:59:59.949509 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.949517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.949748 (+ 231us) server_negotiation.cc:407] Connection header received
0811 18:59:59.949990 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.949994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.950184 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.950319 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:59.950802 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.951541 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.952938 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.953353 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.953492 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:59.954033 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:59.954604 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:59.954776 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.954858 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.954977 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 18:59:59.970930 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:59.965286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.19.155.252:41743)
0811 18:59:59.965777 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.965781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.965801 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:59:59.965976 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.965980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.966152 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.966302 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:59.966672 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.967456 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.968796 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.969185 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.969274 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:59.969705 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:59.970251 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:59.970359 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.970460 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.970530 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":261,"threads_started":1}
I20260811 18:59:59.998718 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:59.978268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.19.155.252:41743)
0811 18:59:59.983935 (+ 5667us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.983945 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.992760 (+ 8815us) server_negotiation.cc:407] Connection header received
0811 18:59:59.992976 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.992981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.993074 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.993173 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:59.993961 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.995029 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.996748 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.997443 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.997585 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:59.997943 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:59.998069 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:59.998183 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.998309 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.998400 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5436}
I20260811 18:59:59.999137 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:59.977515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35114 (local address 127.19.155.253:35319)
0811 18:59:59.977751 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.977761 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.992514 (+ 14753us) server_negotiation.cc:407] Connection header received
0811 18:59:59.992753 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.992759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.992864 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.992955 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:59.993548 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.994386 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.996654 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.997152 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.997296 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:59.998257 (+ 961us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:59:59.998394 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:59:59.998458 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:59:59.998724 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 18:59:59.998823 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 19:00:00.000818 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:59:59.977475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40816 (local address 127.19.155.254:46241)
0811 18:59:59.990550 (+ 13075us) server_negotiation.cc:206] Beginning negotiation
0811 18:59:59.990560 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:59:59.991567 (+ 1007us) server_negotiation.cc:407] Connection header received
0811 18:59:59.992869 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:59:59.992874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:59:59.993116 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:59:59.993358 (+ 242us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:59:59.994269 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.995230 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.997961 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:59:59.998704 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:59:59.998814 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:59:59.999568 (+ 754us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:00.000037 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:00.000155 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:00.000455 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 19:00:00.000556 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12892,"thread_start_us":13103,"threads_started":1}
I20260811 19:00:00.005990 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 24891
I20260811 19:00:00.008275 24997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:00.124689 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 24891
I20260811 19:00:00.160708 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25014
I20260811 19:00:00.161888 25114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:00.273759 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25014
I20260811 19:00:00.300776 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25136
I20260811 19:00:00.301976 25247 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:00.412964 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25136
2026-08-11T19:00:00Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5318 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 19:00:00 dist-test-slave-1nl6 krb5kdc[25506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 19:00:00 dist-test-slave-1nl6 krb5kdc[25506](info): set up 2 sockets
Aug 11 19:00:00 dist-test-slave-1nl6 krb5kdc[25506](info): commencing operation
krb5kdc: starting...
W20260811 19:00:01.803927 20079 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/test-user.keytab.
Aug 11 19:00:02 dist-test-slave-1nl6 krb5kdc[25506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T19:00:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T19:00:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.155.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
Entry for principal kudu/127.19.155.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab.
I20260811 19:00:02.173626 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38003
--webserver_interface=127.19.155.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 19:00:02.541013 25526 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:00:02.541385 25526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:02.541463 25526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:02.541549 25526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:02.549649 25526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:02.549757 25526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:02.549817 25526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:02.549863 25526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:02.549928 25526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:02.560384 25526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.254.keytab
--principal=kudu/127.19.155.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.254:38003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.155.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 19:00:02.561734 25526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:02.563150 25526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:02.575531 25542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:02.575567 25536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:02.575531 25538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:02.576961 25526 server_base.cc:1034] running on GCE node
I20260811 19:00:02.577797 25526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:02.579368 25526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:02.580600 25526 hybrid_clock.cc:648] HybridClock initialized: now 1786474802580531 us; error 34 us; skew 500 ppm
I20260811 19:00:02.580969 25526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 19:00:02 dist-test-slave-1nl6 krb5kdc[25506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:02.584443 25526 init.cc:377] Logged in from keytab as kudu/127.19.155.254@KRBTEST.COM (short username kudu)
I20260811 19:00:02.586030 25526 webserver.cc:460] Webserver started at http://127.19.155.254:36803/ using document root <none> and password file <none>
I20260811 19:00:02.586737 25526 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:02.586833 25526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:02.587196 25526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:02.590289 25526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data/instance:
uuid: "4b9d4d7bb7614ba8b9089756ea220b30"
format_stamp: "Formatted at 2026-08-11 19:00:02 on dist-test-slave-1nl6"
server_key: "b2bfbc932df2f1bb0f95c4f4fa8a2047"
server_key_iv: "0e6b51c1fbda3f15a65d897ae671df32"
server_key_version: "encryptionkey@0"
I20260811 19:00:02.591141 25526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance:
uuid: "4b9d4d7bb7614ba8b9089756ea220b30"
format_stamp: "Formatted at 2026-08-11 19:00:02 on dist-test-slave-1nl6"
server_key: "b2bfbc932df2f1bb0f95c4f4fa8a2047"
server_key_iv: "0e6b51c1fbda3f15a65d897ae671df32"
server_key_version: "encryptionkey@0"
I20260811 19:00:02.596705 25526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 19:00:02.600445 25555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:02.601888 25526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 19:00:02.602088 25526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal
uuid: "4b9d4d7bb7614ba8b9089756ea220b30"
format_stamp: "Formatted at 2026-08-11 19:00:02 on dist-test-slave-1nl6"
server_key: "b2bfbc932df2f1bb0f95c4f4fa8a2047"
server_key_iv: "0e6b51c1fbda3f15a65d897ae671df32"
server_key_version: "encryptionkey@0"
I20260811 19:00:02.602332 25526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:02.629195 25526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:02.633708 25526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:02.634061 25526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:02.654292 25526 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.254:38003
I20260811 19:00:02.654333 25636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.254:38003 every 8 connection(s)
I20260811 19:00:02.655789 25526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/data/info.pb
I20260811 19:00:02.659754 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:02.660735 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25526
I20260811 19:00:02.660984 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-0/wal/instance
I20260811 19:00:02.661620 20079 external_mini_cluster.cc:1428] Setting key 989596b907d8db9125bfeeded0a00a6d
I20260811 19:00:02.670986 25638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:02 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 19:00:02.698722 25643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.676909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.19.155.254:38003)
0811 19:00:02.677703 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:02.677714 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:02.677779 (+ 65us) server_negotiation.cc:407] Connection header received
0811 19:00:02.679108 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:02.679113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:02.679374 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:02.679588 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:02.681276 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:02.682548 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:02.684992 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:02.685603 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:02.685810 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:02.690756 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:02.690766 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:02.690782 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:02.690817 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:02.693870 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:02.694959 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:02.694972 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:02.694975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:02.695138 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:02.695643 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:02.695646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:02.695648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:02.696310 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:02.696462 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:02.697281 (+ 819us) server_negotiation.cc:299] Negotiation successful
0811 19:00:02.697581 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":337,"threads_started":1}
I20260811 19:00:02.698755 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.675514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38003 (local address 127.0.0.1:58290)
0811 19:00:02.676422 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.676471 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:02.678675 (+ 2204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:02.679610 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:02.679617 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:02.680471 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:02.681001 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:02.681030 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:02.682744 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:02.682753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:02.684797 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:02.684816 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:02.685928 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:02.685943 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:02.686217 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:02.687046 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:02.687082 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:02.690435 (+ 3353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:02.694040 (+ 3605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:02.694057 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:02.694075 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:02.694756 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:02.695264 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:02.695272 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:02.695279 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:02.695519 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:02.696490 (+ 971us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:02.696502 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:02.696812 (+ 310us) client_negotiation.cc:769] Sending connection context
0811 19:00:02.697159 (+ 347us) client_negotiation.cc:240] Negotiation successful
0811 19:00:02.697797 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":51,"thread_start_us":380,"threads_started":1}
WARNING: no policy specified for kudu/127.19.155.253@KRBTEST.COM; defaulting to no policy
I20260811 19:00:02.702188 25638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.253@KRBTEST.COM" created.
I20260811 19:00:02.703614 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.703172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55044)
0811 19:00:02.703360 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.703481 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 19:00:02.706171 25559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
I20260811 19:00:02.707965 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.707562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55060)
0811 19:00:02.707727 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.707815 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 19:00:02.708168 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:41055: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
Entry for principal kudu/127.19.155.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab.
I20260811 19:00:02.744000 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:41055
--webserver_interface=127.19.155.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:02.757556 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } attempt: 1
I20260811 19:00:02.758867 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.758367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55076)
0811 19:00:02.758603 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.758732 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 19:00:02.760059 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.759689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55078)
0811 19:00:02.759842 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.759922 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 19:00:02.760303 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:41055: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
I20260811 19:00:02.828622 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } attempt: 2
I20260811 19:00:02.829958 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.829426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55082)
0811 19:00:02.829710 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.829805 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 19:00:02.831210 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.830778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55092)
0811 19:00:02.830989 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.831066 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 19:00:02.831502 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:41055: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
I20260811 19:00:02.922809 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } attempt: 3
I20260811 19:00:02.924321 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.923766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55094)
0811 19:00:02.924014 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.924141 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 19:00:02.925645 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:02.925184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55100)
0811 19:00:02.925361 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:02.925461 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 19:00:02.925973 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:41055: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
I20260811 19:00:03.069300 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } attempt: 4
I20260811 19:00:03.070717 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.070110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55106)
0811 19:00:03.070473 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.070567 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211}
I20260811 19:00:03.071905 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.071509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55122)
0811 19:00:03.071673 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.071766 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 19:00:03.072110 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.253:41055: Network error: Client connection negotiation failed: client connection to 127.19.155.253:41055: connect: Connection refused (error 111)
W20260811 19:00:03.115079 25647 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:00:03.115677 25647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:03.115808 25647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:03.116073 25647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:03.123795 25647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:03.123912 25647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:03.124037 25647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:03.124130 25647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:03.124226 25647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:03.135051 25647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.253.keytab
--principal=kudu/127.19.155.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.253:41055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.155.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 19:00:03.136567 25647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:03.138183 25647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:03.152166 25653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:03.152112 25658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:03.152199 25654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:03.156774 25647 server_base.cc:1034] running on GCE node
I20260811 19:00:03.157765 25647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:03.159523 25647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:03.160845 25647 hybrid_clock.cc:648] HybridClock initialized: now 1786474803160780 us; error 61 us; skew 500 ppm
I20260811 19:00:03.161291 25647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:03.169836 25647 init.cc:377] Logged in from keytab as kudu/127.19.155.253@KRBTEST.COM (short username kudu)
I20260811 19:00:03.171939 25647 webserver.cc:460] Webserver started at http://127.19.155.253:44913/ using document root <none> and password file <none>
I20260811 19:00:03.172817 25647 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:03.172976 25647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:03.173336 25647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:03.176680 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data/instance:
uuid: "785a66c7f49a4976bca0c52abb5235b0"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "c6c220ee4f33b9159164ef6e69e5e40d"
server_key_iv: "81ce82cca8c96cfab929ac9bd0f38ec2"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.177570 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal/instance:
uuid: "785a66c7f49a4976bca0c52abb5235b0"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "c6c220ee4f33b9159164ef6e69e5e40d"
server_key_iv: "81ce82cca8c96cfab929ac9bd0f38ec2"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.183822 25647 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 19:00:03.187691 25666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:03.189152 25647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 19:00:03.189373 25647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal
uuid: "785a66c7f49a4976bca0c52abb5235b0"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "c6c220ee4f33b9159164ef6e69e5e40d"
server_key_iv: "81ce82cca8c96cfab929ac9bd0f38ec2"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.189632 25647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:03.208076 25647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:03.212878 25647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:03.213212 25647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:03.233548 25647 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.253:41055
I20260811 19:00:03.233592 25756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.253:41055 every 8 connection(s)
I20260811 19:00:03.235167 25647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/data/info.pb
I20260811 19:00:03.239251 25757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:03.242261 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25647
I20260811 19:00:03.242503 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-1/wal/instance
I20260811 19:00:03.243026 20079 external_mini_cluster.cc:1428] Setting key ece80ac46519933fbb4ec54443cfce27
I20260811 19:00:03.246284 25757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 19:00:03.268692 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.249242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.19.155.254:38003)
0811 19:00:03.249799 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.249804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.250877 (+ 1073us) server_negotiation.cc:407] Connection header received
0811 19:00:03.252961 (+ 2084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.252967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.253067 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.253203 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.254956 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.255769 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.257431 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.257865 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.258019 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.261962 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.261967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.261971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.262009 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.265012 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.265937 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.265949 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.265952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.266083 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.266624 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.266630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.266634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.267025 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.267200 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.268002 (+ 802us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.268261 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":315,"threads_started":1}
I20260811 19:00:03.269755 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.249841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38003 (local address 127.0.0.1:58296)
0811 19:00:03.250666 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.250713 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.252618 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.253491 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.253499 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.254076 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.254684 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.254703 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.255958 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.255963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.257257 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.257272 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.258130 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.258138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.258403 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.259289 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.259314 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.261674 (+ 2360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.265222 (+ 3548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.265233 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.265256 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.265773 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.266237 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.266243 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.266246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.266496 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.267188 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.267197 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.267597 (+ 400us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.267904 (+ 307us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.268504 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":368,"threads_started":1}
I20260811 19:00:03.271878 25757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.155.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.155.252@KRBTEST.COM" created.
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 19:00:03.288197 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.272891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55138)
0811 19:00:03.273112 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.273133 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.273244 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.274331 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.274335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.274840 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.275048 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.275058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.276522 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.276529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.277422 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.277434 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.278394 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.278400 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.278579 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.279305 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.279325 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.281680 (+ 2355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.285377 (+ 3697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.285383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.285387 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.285793 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.286231 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.286237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.286240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.286396 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.287111 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.287116 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.287294 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.287446 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.287758 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 19:00:03.288244 25762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.273086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.19.155.253:41055)
0811 19:00:03.273847 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.273853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.273882 (+ 29us) server_negotiation.cc:407] Connection header received
0811 19:00:03.273936 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.273942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.274132 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.274349 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.275248 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.276370 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.277576 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.278210 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.278371 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.281969 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.281985 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.282003 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.282037 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.285180 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.285950 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.285965 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.285967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.286094 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.286514 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.286521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.286525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.286980 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.287216 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.287629 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.287855 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":460,"threads_started":1}
I20260811 19:00:03.291167 25757 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:03.292520 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.291968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36482)
0811 19:00:03.292213 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.292350 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 19:00:03.292821 25667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.294777 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.294260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36490)
0811 19:00:03.294479 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.294600 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 19:00:03.295113 25757 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
Entry for principal kudu/127.19.155.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab.
I20260811 19:00:03.322471 20079 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVECISF/build/asan/bin/kudu
/tmp/dist-test-taskVECISF/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:37123
--webserver_interface=127.19.155.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.155.212:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 19:00:03.344488 25757 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 1
I20260811 19:00:03.346190 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.345288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36496)
0811 19:00:03.345749 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.345932 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260}
I20260811 19:00:03.347502 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.346999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36508)
0811 19:00:03.347199 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.347301 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 19:00:03.347893 25757 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.371412 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } attempt: 5
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 19:00:03.387349 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.372283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55140)
0811 19:00:03.372493 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.372513 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.372632 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.373078 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.373081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.373512 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.373722 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.373733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.375147 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.375153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.376032 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.376045 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.377068 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.377073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.377266 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.377948 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.377966 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.380376 (+ 2410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.384524 (+ 4148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.384529 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.384532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.384948 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.385475 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.385482 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.385484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.385643 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.386355 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.386359 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.386523 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.386659 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.387067 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 19:00:03.387483 25762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.372368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55140 (local address 127.19.155.253:41055)
0811 19:00:03.372566 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.372573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.372599 (+ 26us) server_negotiation.cc:407] Connection header received
0811 19:00:03.372786 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.372791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.372902 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.373041 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.373914 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.374989 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.376210 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.376898 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.377034 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.380637 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.380645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.380651 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.380696 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.384291 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.385108 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.385118 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.385123 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.385291 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.385795 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.385800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.385803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.386205 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.386376 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.386802 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.387155 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 19:00:03.388760 25638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } has no permanent_uuid. Determining permanent_uuid...
I20260811 19:00:03.390007 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.389592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36514)
0811 19:00:03.389785 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.389866 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 19:00:03.391108 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.390680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36530)
0811 19:00:03.390839 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.390989 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 19:00:03.391351 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.416158 25757 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 2
I20260811 19:00:03.417438 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.416911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36532)
0811 19:00:03.417142 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.417264 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 19:00:03.418570 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.418184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36538)
0811 19:00:03.418353 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.418440 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 19:00:03.418813 25757 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.442597 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 1
I20260811 19:00:03.444005 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.443392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36550)
0811 19:00:03.443656 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.443779 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 19:00:03.445194 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.444755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36562)
0811 19:00:03.444967 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.445057 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260811 19:00:03.445461 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.510103 25757 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 3
I20260811 19:00:03.511432 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.510845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36570)
0811 19:00:03.511161 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.511267 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 19:00:03.512809 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.512202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36582)
0811 19:00:03.512506 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.512621 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260811 19:00:03.513123 25757 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.513705 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 2
I20260811 19:00:03.514979 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.514339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36588)
0811 19:00:03.514603 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.514721 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 19:00:03.516209 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.515723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36598)
0811 19:00:03.515921 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.516025 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 19:00:03.516530 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.622825 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 3
I20260811 19:00:03.624198 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.623593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36614)
0811 19:00:03.623860 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.623983 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 19:00:03.625463 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.624974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36618)
0811 19:00:03.625203 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.625311 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260811 19:00:03.625824 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.656404 25757 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 4
I20260811 19:00:03.657932 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.657239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36634)
0811 19:00:03.657548 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.657690 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 19:00:03.659238 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.658795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36642)
0811 19:00:03.659004 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.659092 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260811 19:00:03.659475 25757 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
W20260811 19:00:03.702667 25769 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 19:00:03.703217 25769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 19:00:03.703363 25769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 19:00:03.703514 25769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 19:00:03.711644 25769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 19:00:03.711794 25769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 19:00:03.711900 25769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 19:00:03.711993 25769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 19:00:03.712088 25769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 19:00:03.722759 25769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.155.212:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.155.254:38003,127.19.155.253:41055,127.19.155.252:37123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/krb5kdc/kudu_127.19.155.252.keytab
--principal=kudu/127.19.155.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.155.252:37123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.155.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 16:09:54 UTC on ccycloud.quasar-hitlqc.root.comops.site
build id 4580676
ASAN enabled
I20260811 19:00:03.724472 25769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 19:00:03.726030 25769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 19:00:03.739109 25776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:03.739248 25778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 19:00:03.739149 25780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 19:00:03.740525 25769 server_base.cc:1034] running on GCE node
I20260811 19:00:03.741472 25769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 19:00:03.743172 25769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 19:00:03.744477 25769 hybrid_clock.cc:648] HybridClock initialized: now 1786474803744399 us; error 47 us; skew 500 ppm
I20260811 19:00:03.744882 25769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 19:00:03.748560 25769 init.cc:377] Logged in from keytab as kudu/127.19.155.252@KRBTEST.COM (short username kudu)
I20260811 19:00:03.750348 25769 webserver.cc:460] Webserver started at http://127.19.155.252:38065/ using document root <none> and password file <none>
I20260811 19:00:03.751199 25769 fs_manager.cc:359] Metadata directory not provided
I20260811 19:00:03.751309 25769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 19:00:03.751597 25769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 19:00:03.754770 25769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data/instance:
uuid: "9b79dbb8940645cfaf45b0b78c1b36ab"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "800d9c940d935aee9f2a37d23dc8661e"
server_key_iv: "4f2f1f424b273e25e6f506e78a13202e"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.755702 25769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal/instance:
uuid: "9b79dbb8940645cfaf45b0b78c1b36ab"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "800d9c940d935aee9f2a37d23dc8661e"
server_key_iv: "4f2f1f424b273e25e6f506e78a13202e"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.761701 25769 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 19:00:03.768280 25790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 19:00:03.770573 25769 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 19:00:03.770828 25769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data,/tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal
uuid: "9b79dbb8940645cfaf45b0b78c1b36ab"
format_stamp: "Formatted at 2026-08-11 19:00:03 on dist-test-slave-1nl6"
server_key: "800d9c940d935aee9f2a37d23dc8661e"
server_key_iv: "4f2f1f424b273e25e6f506e78a13202e"
server_key_version: "encryptionkey@0"
I20260811 19:00:03.771214 25769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 19:00:03.798784 25769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 19:00:03.803073 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 4
I20260811 19:00:03.804186 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.803736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36644)
0811 19:00:03.803935 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.804042 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 19:00:03.804772 25769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 19:00:03.805189 25769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 19:00:03.811544 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.805006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36652)
0811 19:00:03.811204 (+ 6198us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.811337 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6015}
W20260811 19:00:03.811880 25638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.155.252:37123: Network error: Client connection negotiation failed: client connection to 127.19.155.252:37123: connect: Connection refused (error 111)
I20260811 19:00:03.834558 25866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.155.252:37123 every 8 connection(s)
I20260811 19:00:03.834596 25769 rpc_server.cc:307] RPC server started. Bound to: 127.19.155.252:37123
I20260811 19:00:03.837247 25769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/data/info.pb
I20260811 19:00:03.842037 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 19:00:03.843699 20079 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVECISF/build/asan/bin/kudu as pid 25769
I20260811 19:00:03.843928 20079 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVECISF/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474422014372-20079-0/minicluster-data/master-2/wal/instance
I20260811 19:00:03.844496 20079 external_mini_cluster.cc:1428] Setting key aa27b6be27b970c4b5001df817e24c34
I20260811 19:00:03.854332 25867 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
I20260811 19:00:03.890482 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.846637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.19.155.252:37123)
0811 19:00:03.859252 (+ 12615us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.859274 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.859336 (+ 62us) server_negotiation.cc:407] Connection header received
0811 19:00:03.862524 (+ 3188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.862570 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.863290 (+ 720us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.863816 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.867000 (+ 3184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.869560 (+ 2560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.871846 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.873023 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.873234 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.879179 (+ 5945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.879189 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.879205 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.879243 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.883487 (+ 4244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.884785 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.884799 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.884811 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.884995 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.885461 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.885468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.885474 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.886331 (+ 857us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.886690 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.888510 (+ 1820us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.889010 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12308,"thread_start_us":12023,"threads_started":1}
I20260811 19:00:03.891125 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.859651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.254:38003 (local address 127.0.0.1:58306)
0811 19:00:03.871605 (+ 11954us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.871667 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.871861 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.872940 (+ 1079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.872948 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.873817 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.874203 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.874222 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.875517 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.875523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.876871 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.876885 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.878044 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.878055 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.878316 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.879182 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.879222 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.882393 (+ 3171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.887289 (+ 4896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.887305 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.887316 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.888016 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.888513 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.888520 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.888526 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.888727 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.889420 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.889431 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.889699 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.889957 (+ 258us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.890389 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11626,"thread_start_us":11455,"threads_started":1}
I20260811 19:00:03.891167 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.859666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.19.155.254:38003)
0811 19:00:03.872393 (+ 12727us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.872399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.872421 (+ 22us) server_negotiation.cc:407] Connection header received
0811 19:00:03.872485 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.872490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.872584 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.872699 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.874408 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.875322 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.877054 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.877734 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.878005 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.882660 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.882667 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.882671 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.882712 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.887095 (+ 4383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.888185 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.888191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.888194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.888368 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.888876 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.888881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.888887 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.889261 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.889428 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.890113 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.890377 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12590,"thread_start_us":12416,"threads_started":1}
I20260811 19:00:03.893942 25867 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.254@KRBTEST.COM
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
I20260811 19:00:03.913848 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.894764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58318 (local address 127.19.155.254:38003)
0811 19:00:03.895948 (+ 1184us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.895954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.895974 (+ 20us) server_negotiation.cc:407] Connection header received
0811 19:00:03.896044 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.896048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.896138 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.896243 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.898381 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.899229 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.900554 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.900974 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.901130 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.905831 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.905853 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.905862 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.905963 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.910236 (+ 4273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.911190 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.911198 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.911205 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.911381 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.911879 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.911886 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.911892 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.912366 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.912714 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.913103 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.913391 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045}
I20260811 19:00:03.915272 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.894941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.253:41055 (local address 127.0.0.1:55144)
0811 19:00:03.895142 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.895164 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.895287 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.898446 (+ 3159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.898454 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.899119 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.899368 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.899384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.901299 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.901308 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.903114 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.903139 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.904597 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.904609 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.904858 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.905655 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.905684 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.908034 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.912078 (+ 4044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.912084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.912088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.912581 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.913082 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.913087 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.913090 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.913296 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.914239 (+ 943us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.914242 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.914383 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.914550 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.914880 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 19:00:03.915983 25879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.895359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55144 (local address 127.19.155.253:41055)
0811 19:00:03.895947 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.895954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.895974 (+ 20us) server_negotiation.cc:407] Connection header received
0811 19:00:03.896039 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.896043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.896123 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.896244 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.899645 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.901086 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.903346 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.904274 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.904436 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.908479 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.908485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.908488 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.908522 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.911928 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.912749 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.912755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.912758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.912937 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.913442 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.913450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.913455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.913804 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.914013 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.914658 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.914879 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":340,"threads_started":1}
I20260811 19:00:03.917936 25867 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.155.253@KRBTEST.COM
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.252@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 19:00:03.935024 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.916155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55156 (local address 127.19.155.253:41055)
0811 19:00:03.916909 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.916917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.916946 (+ 29us) server_negotiation.cc:407] Connection header received
0811 19:00:03.916990 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.916994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.917066 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.917264 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.918874 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.919850 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.921510 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.921999 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.922150 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.928448 (+ 6298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.928456 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.928461 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.928502 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.931820 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.932675 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.932682 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.932685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.932846 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.933289 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.933294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.933298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.933624 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.933929 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.934253 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.934498 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":339,"threads_started":1}
I20260811 19:00:03.937861 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.919323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36660)
0811 19:00:03.919595 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.919618 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.919746 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.920185 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.920191 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.920721 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.920902 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.920914 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.922516 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.922522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.923948 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.923967 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.925156 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.925163 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.925431 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.926181 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.926211 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.928495 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.934291 (+ 5796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.934298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.934304 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.934932 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.935372 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.935379 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.935384 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.935559 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.936460 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.936468 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.936659 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.936857 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.937278 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260811 19:00:03.937868 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.919049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.19.155.252:37123)
0811 19:00:03.919263 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.919271 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.919871 (+ 600us) server_negotiation.cc:407] Connection header received
0811 19:00:03.919921 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.919928 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.920008 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.920116 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.921077 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.922356 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.924134 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.924956 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.925115 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.928744 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.928754 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.928760 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.928811 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.934102 (+ 5291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.935075 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.935082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.935088 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.935243 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.935722 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.935729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.935735 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.936221 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.936399 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.936981 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.937495 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":207,"server-negotiator.queue_time_us":73}
I20260811 19:00:03.943909 25867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: Bootstrap starting.
I20260811 19:00:03.944205 20079 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 19:00:03.947611 25867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:03.949216 25867 log.cc:824] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:03.948362 25596 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "4b9d4d7bb7614ba8b9089756ea220b30"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58318
I20260811 19:00:03.954128 25867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: No bootstrap required, opened a new log
I20260811 19:00:03.961617 25757 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 5
I20260811 19:00:03.961941 25867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:03.962415 25867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b79dbb8940645cfaf45b0b78c1b36ab, State: Initialized, Role: FOLLOWER
I20260811 19:00:03.963058 25867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:03.964623 25887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:03.965626 25887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:03.966020 25867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 19:00:03 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474803, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.253@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 19:00:03.985291 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.962401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36666)
0811 19:00:03.962737 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:03.962761 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:03.962968 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:03.963384 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:03.963391 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:03.964021 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:03.964302 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.964319 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.966223 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.966231 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.968343 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:03.968366 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.969955 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.969964 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:03.970286 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.971149 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:03.971180 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:03.974765 (+ 3585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:03.980459 (+ 5694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.980496 (+ 37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.980503 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.981911 (+ 1408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.982578 (+ 667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:03.982583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:03.982587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:03.982818 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:03.983938 (+ 1120us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:03.983946 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:03.984168 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 19:00:03.984339 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 19:00:03.984732 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260811 19:00:03.986764 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:03.962464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36666 (local address 127.19.155.252:37123)
0811 19:00:03.962699 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:03.962706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:03.962992 (+ 286us) server_negotiation.cc:407] Connection header received
0811 19:00:03.963099 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:03.963104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:03.963191 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:03.963317 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:03.964523 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.965998 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.968565 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:03.969493 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:03.969640 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:03.975134 (+ 5494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:03.975145 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:03.975151 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:03.975209 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:03.980153 (+ 4944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.982157 (+ 2004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.982165 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.982170 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.982355 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:03.983028 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:03.983040 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:03.983045 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:03.983625 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:03.983857 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:03.986016 (+ 2159us) server_negotiation.cc:299] Negotiation successful
0811 19:00:03.986315 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 19:00:03.994046 25757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: Bootstrap starting.
I20260811 19:00:03.999123 25757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: Neither blocks nor log segments found. Creating new log.
W20260811 19:00:04.002139 25903 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 19:00:04.003954 25757 log.cc:824] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: Log is configured to *not* fsync() on all Append() calls
W20260811 19:00:04.002302 25903 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:03.988333 25769 master_runner.cc:186] Error getting master registration for 127.19.155.254:38003: OK, instance_id { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" instance_seqno: 1786474802648521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:00:04.006006 25769 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 19:00:04.014590 25757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: No bootstrap required, opened a new log
I20260811 19:00:04.027010 25757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.027508 25757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785a66c7f49a4976bca0c52abb5235b0, State: Initialized, Role: FOLLOWER
I20260811 19:00:04.028105 25757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.029465 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.029985 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.031064 25757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 19:00:04.063081 25803 tablet.cc:2369] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 19:00:04.074851 25930 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 19:00:04.075062 25930 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 19:00:04.068199 25647 master_runner.cc:186] Error getting master registration for 127.19.155.254:38003: OK, instance_id { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" instance_seqno: 1786474802648521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 19:00:04.089186 25638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } attempt: 5
I20260811 19:00:04.089761 25647 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 19:00:04 dist-test-slave-1nl6 krb5kdc[25506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.155.254@KRBTEST.COM for kudu/127.19.155.252@KRBTEST.COM
I20260811 19:00:04.113641 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:04.090119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.155.252:37123 (local address 127.0.0.1:36668)
0811 19:00:04.090480 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 19:00:04.090503 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 19:00:04.090664 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 19:00:04.091278 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 19:00:04.091284 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 19:00:04.091875 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 19:00:04.092122 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:04.092173 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.093874 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.093880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:04.095370 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 19:00:04.095405 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.096926 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.096932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 19:00:04.097154 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:04.098015 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 19:00:04.098041 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 19:00:04.101306 (+ 3265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 19:00:04.107532 (+ 6226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:04.107539 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:04.107544 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:04.108571 (+ 1027us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:04.109627 (+ 1056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 19:00:04.109663 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 19:00:04.109668 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 19:00:04.110001 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 19:00:04.111264 (+ 1263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 19:00:04.111269 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 19:00:04.111582 (+ 313us) client_negotiation.cc:769] Sending connection context
0811 19:00:04.111839 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 19:00:04.112417 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260811 19:00:04.115561 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:04.090218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36668 (local address 127.19.155.252:37123)
0811 19:00:04.090434 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.090441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.090576 (+ 135us) server_negotiation.cc:407] Connection header received
0811 19:00:04.090805 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.090811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.090924 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.091048 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.092402 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.093630 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.095680 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.096495 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.096658 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:04.101679 (+ 5021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:04.101690 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:04.101695 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:04.101751 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:04.106855 (+ 5104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.108929 (+ 2074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.108940 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.108968 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.109352 (+ 384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.110294 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.110300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.110328 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.111059 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:04.113180 (+ 2121us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:04.113721 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 19:00:04.114846 (+ 1125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 19:00:04.122488 25638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30: Bootstrap starting.
I20260811 19:00:04.127892 25638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30: Neither blocks nor log segments found. Creating new log.
I20260811 19:00:04.130411 25638 log.cc:824] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30: Log is configured to *not* fsync() on all Append() calls
I20260811 19:00:04.136281 25638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30: No bootstrap required, opened a new log
I20260811 19:00:04.150452 25638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.151398 25638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9d4d7bb7614ba8b9089756ea220b30, State: Initialized, Role: FOLLOWER
I20260811 19:00:04.152406 25638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.154034 25935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.154568 25935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.157097 25596 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 19:00:04.157336 25596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:04.157589 25638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 19:00:04.161274 25596 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.164287 25705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "785a66c7f49a4976bca0c52abb5235b0"
I20260811 19:00:04.164817 25596 leader_election.cc:288] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [CANDIDATE]: Term 1 election: Requested vote from peers 785a66c7f49a4976bca0c52abb5235b0 (127.19.155.253:41055), 9b79dbb8940645cfaf45b0b78c1b36ab (127.19.155.252:37123)
I20260811 19:00:04.165045 25705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:04.170308 25705 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9d4d7bb7614ba8b9089756ea220b30 in term 1.
I20260811 19:00:04.171648 25559 leader_election.cc:302] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b9d4d7bb7614ba8b9089756ea220b30, 785a66c7f49a4976bca0c52abb5235b0; no voters:
I20260811 19:00:04.172361 25935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 19:00:04.173091 25935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [term 1 LEADER]: Becoming Leader. State: Replica: 4b9d4d7bb7614ba8b9089756ea220b30, State: Running, Role: LEADER
I20260811 19:00:04.173914 25935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } }
I20260811 19:00:04.179397 25947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b9d4d7bb7614ba8b9089756ea220b30. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.180048 25947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:04.179435 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab"
I20260811 19:00:04.180509 25832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 19:00:04.184324 25832 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b9d4d7bb7614ba8b9089756ea220b30 in term 1.
I20260811 19:00:04.193594 25959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260811 19:00:04.216496 25673 tablet.cc:2369] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 19:00:04.231316 25959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 19:00:04.258138 25832 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [term 1 FOLLOWER]: Refusing update from remote peer 4b9d4d7bb7614ba8b9089756ea220b30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:04.259872 25947 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:04.267437 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:04.193596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58334 (local address 127.19.155.254:38003)
0811 19:00:04.193817 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.193828 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.198998 (+ 5170us) server_negotiation.cc:407] Connection header received
0811 19:00:04.199878 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.199889 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.200017 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.200124 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.206524 (+ 6400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.208035 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.220324 (+ 12289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.221451 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.221607 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:04.247113 (+ 25506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:04.247122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:04.247127 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:04.247206 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:04.251730 (+ 4524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.252717 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.252725 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.252729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.252909 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.253381 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.253387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.253390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.253794 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:04.254095 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:04.254940 (+ 845us) server_negotiation.cc:299] Negotiation successful
0811 19:00:04.255307 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 19:00:04.269080 25705 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [term 1 FOLLOWER]: Refusing update from remote peer 4b9d4d7bb7614ba8b9089756ea220b30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 19:00:04.270406 25947 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 19:00:04.291833 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:04.195610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36684 (local address 127.19.155.252:37123)
0811 19:00:04.195871 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.195881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.211785 (+ 15904us) server_negotiation.cc:407] Connection header received
0811 19:00:04.213308 (+ 1523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.213318 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.213487 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.213590 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.234233 (+ 20643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.235433 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.240473 (+ 5040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.241223 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.241324 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:04.281588 (+ 40264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:04.281596 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:04.281601 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:04.281659 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:04.286683 (+ 5024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.288169 (+ 1486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.288179 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.288185 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.288434 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.289035 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.289045 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.289050 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.289626 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:04.289950 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:04.290760 (+ 810us) server_negotiation.cc:299] Negotiation successful
0811 19:00:04.291180 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 19:00:04.303602 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:04.194954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55158 (local address 127.19.155.253:41055)
0811 19:00:04.195152 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.195158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.212505 (+ 17347us) server_negotiation.cc:407] Connection header received
0811 19:00:04.215141 (+ 2636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.215152 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.215300 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.215417 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.228088 (+ 12671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.229663 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.238527 (+ 8864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:04.239272 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:04.239384 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:04.292862 (+ 53478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 19:00:04.292874 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 19:00:04.292883 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 19:00:04.292956 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 19:00:04.298459 (+ 5503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.299920 (+ 1461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.299929 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.299935 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.300178 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 19:00:04.300845 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 19:00:04.300853 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 19:00:04.300859 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 19:00:04.301412 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 19:00:04.301723 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:04.302595 (+ 872us) server_negotiation.cc:299] Negotiation successful
0811 19:00:04.303040 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 19:00:04.332001 25987 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 19:00:04.332634 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b9d4d7bb7614ba8b9089756ea220b30. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.333038 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.335559 25887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b9d4d7bb7614ba8b9089756ea220b30. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.335918 25887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.338161 25979 mvcc.cc:205] Tried to move back new op lower bound from 7317400798226321408 to 7317400797905178624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400798226321408}]
I20260811 19:00:04.349627 25947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.349949 25947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:04.350229 25947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.350448 25947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30 [sys.catalog]: This master's current role is: LEADER
I20260811 19:00:04.362385 25959 catalog_manager.cc:1347] Generated new cluster ID: 520cdc18f1a8479b835a94579dc504cc
I20260811 19:00:04.362533 25959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 19:00:04.362855 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.371232 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.373204 25887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b9d4d7bb7614ba8b9089756ea220b30" member_type: VOTER last_known_addr { host: "127.19.155.254" port: 38003 } } peers { permanent_uuid: "785a66c7f49a4976bca0c52abb5235b0" member_type: VOTER last_known_addr { host: "127.19.155.253" port: 41055 } } peers { permanent_uuid: "9b79dbb8940645cfaf45b0b78c1b36ab" member_type: VOTER last_known_addr { host: "127.19.155.252" port: 37123 } } }
I20260811 19:00:04.373487 25887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab [sys.catalog]: This master's current role is: FOLLOWER
I20260811 19:00:04.375260 25981 mvcc.cc:205] Tried to move back new op lower bound from 7317400798226321408 to 7317400797905178624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400798226321408 or (T in {7317400798226321408})}]
I20260811 19:00:04.375715 25980 mvcc.cc:205] Tried to move back new op lower bound from 7317400798226321408 to 7317400797905178624. Current Snapshot: MvccSnapshot[applied={T|T < 7317400798226321408 or (T in {7317400798226321408})}]
I20260811 19:00:04.403792 25959 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 19:00:04.413910 25959 catalog_manager.cc:1504] Loading token signing keys...
I20260811 19:00:04.442440 25959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b9d4d7bb7614ba8b9089756ea220b30: Generated new TSK 0
I20260811 19:00:04.443765 25959 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 19:00:04.586459 20079 mini_kdc.cc:348] Time spent kdestroy: real 0.121s user 0.000s sys 0.035s
W20260811 19:00:04.653963 25877 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.645236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58346 (local address 127.19.155.254:38003)
0811 19:00:04.645468 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.645477 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.651789 (+ 6312us) server_negotiation.cc:407] Connection header received
0811 19:00:04.652030 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.652037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.652164 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.652315 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.653680 (+ 1365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58346: BlockingRecv error: recv got EOF from 127.0.0.1:58346 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 19:00:04.656726 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.646242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55168 (local address 127.19.155.253:41055)
0811 19:00:04.646501 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.646508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.654739 (+ 8231us) server_negotiation.cc:407] Connection header received
0811 19:00:04.655087 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.655092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.655181 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.655269 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.656477 (+ 1208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55168: BlockingRecv error: recv got EOF from 127.0.0.1:55168 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 19:00:04.656726 25875 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.645254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.19.155.252:37123)
0811 19:00:04.645472 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.645478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.654750 (+ 9272us) server_negotiation.cc:407] Connection header received
0811 19:00:04.655086 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.655092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.655181 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.655257 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.656466 (+ 1209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36698: BlockingRecv error: recv got EOF from 127.0.0.1:36698 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 19:00:04.707715 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.698124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.19.155.253:41055)
0811 19:00:04.698333 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.698347 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.705358 (+ 7011us) server_negotiation.cc:407] Connection header received
0811 19:00:04.705963 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.705970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.706122 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.706200 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.707440 (+ 1240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55170: BlockingRecv error: recv got EOF from 127.0.0.1:55170 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 19:00:04.744062 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.741386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55178 (local address 127.19.155.253:41055)
0811 19:00:04.741622 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.741629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.742270 (+ 641us) server_negotiation.cc:407] Connection header received
0811 19:00:04.742498 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.742504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.742612 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.742756 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.743770 (+ 1014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55178: BlockingRecv error: recv got EOF from 127.0.0.1:55178 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 19:00:04.757834 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.753558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55188 (local address 127.19.155.253:41055)
0811 19:00:04.753767 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.753774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.754354 (+ 580us) server_negotiation.cc:407] Connection header received
0811 19:00:04.754599 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.754607 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.754728 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.754877 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.755915 (+ 1038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55188: BlockingRecv error: recv got EOF from 127.0.0.1:55188 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 19:00:04.766822 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.764228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55194 (local address 127.19.155.253:41055)
0811 19:00:04.764458 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.764465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.765058 (+ 593us) server_negotiation.cc:407] Connection header received
0811 19:00:04.765290 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.765296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.765410 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.765531 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.766514 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55194: BlockingRecv error: recv got EOF from 127.0.0.1:55194 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 19:00:04.781442 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.778666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55204 (local address 127.19.155.253:41055)
0811 19:00:04.778894 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.778955 (+ 61us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.779656 (+ 701us) server_negotiation.cc:407] Connection header received
0811 19:00:04.779935 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.779941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.780069 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.780194 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.781155 (+ 961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55204: BlockingRecv error: recv got EOF from 127.0.0.1:55204 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 19:00:04.804185 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.801401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55216 (local address 127.19.155.253:41055)
0811 19:00:04.801647 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.801655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.802268 (+ 613us) server_negotiation.cc:407] Connection header received
0811 19:00:04.802498 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.802505 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.802633 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.802791 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.803846 (+ 1055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55216: BlockingRecv error: recv got EOF from 127.0.0.1:55216 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 19:00:04.843441 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.841095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.19.155.253:41055)
0811 19:00:04.841283 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.841289 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.841868 (+ 579us) server_negotiation.cc:407] Connection header received
0811 19:00:04.842051 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.842058 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.842162 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.842283 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.843199 (+ 916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55224: BlockingRecv error: recv got EOF from 127.0.0.1:55224 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 19:00:04.913511 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:04.911353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55238 (local address 127.19.155.253:41055)
0811 19:00:04.911637 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:04.911644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:04.911931 (+ 287us) server_negotiation.cc:407] Connection header received
0811 19:00:04.912207 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:04.912212 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:04.912319 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:04.912447 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:04.913261 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55238: BlockingRecv error: recv got EOF from 127.0.0.1:55238 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 19:00:05.006537 25903 catalog_manager.cc:1259] Loaded cluster ID: 520cdc18f1a8479b835a94579dc504cc
I20260811 19:00:05.006647 25903 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: loading cluster ID for follower catalog manager: success
I20260811 19:00:05.009254 25903 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: acquiring CA information for follower catalog manager: success
I20260811 19:00:05.011108 25903 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9b79dbb8940645cfaf45b0b78c1b36ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 19:00:05.048115 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 19:00:05.046084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55240 (local address 127.19.155.253:41055)
0811 19:00:05.046315 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.046320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.046601 (+ 281us) server_negotiation.cc:407] Connection header received
0811 19:00:05.046836 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.046847 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.046955 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.047060 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 19:00:05.047915 (+ 855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55240: BlockingRecv error: recv got EOF from 127.0.0.1:55240 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 19:00:05.077728 25930 catalog_manager.cc:1259] Loaded cluster ID: 520cdc18f1a8479b835a94579dc504cc
I20260811 19:00:05.077842 25930 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: loading cluster ID for follower catalog manager: success
I20260811 19:00:05.080649 25930 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: acquiring CA information for follower catalog manager: success
I20260811 19:00:05.082856 25930 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 785a66c7f49a4976bca0c52abb5235b0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 19:00:05.314433 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:05.308408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.19.155.253:41055)
0811 19:00:05.308604 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.308609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.308850 (+ 241us) server_negotiation.cc:407] Connection header received
0811 19:00:05.309015 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.309019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.309209 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.309326 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:05.309854 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.310659 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.312167 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.312603 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.312727 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:05.313263 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:05.313822 (+ 559us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:05.313956 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:05.314108 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 19:00:05.314188 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 19:00:05.328027 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:05.320981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36710 (local address 127.19.155.252:37123)
0811 19:00:05.321759 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.321764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.321783 (+ 19us) server_negotiation.cc:407] Connection header received
0811 19:00:05.321895 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.321899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.322055 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.322213 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:05.322655 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.323825 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.325341 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.325769 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.325881 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:05.326523 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:05.327255 (+ 732us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:05.327378 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:05.327545 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 19:00:05.327624 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":542,"threads_started":1}
I20260811 19:00:05.343192 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:05.335090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.19.155.253:41055)
0811 19:00:05.335313 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.335321 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.335967 (+ 646us) server_negotiation.cc:407] Connection header received
0811 19:00:05.336528 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.336536 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.336653 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.336755 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:05.337518 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.338545 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.340931 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.341574 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.341748 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:05.342320 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:05.342472 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:05.342572 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:05.342772 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 19:00:05.342866 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 19:00:05.344277 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:05.335546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58350 (local address 127.19.155.254:38003)
0811 19:00:05.337201 (+ 1655us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.337209 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.337237 (+ 28us) server_negotiation.cc:407] Connection header received
0811 19:00:05.337389 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.337397 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.337659 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.337913 (+ 254us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:05.338517 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.339753 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.341550 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.342181 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.342299 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:05.343056 (+ 757us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:05.343584 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:05.343719 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:05.343863 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 19:00:05.343953 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1490,"thread_start_us":1394,"threads_started":1}
I20260811 19:00:05.346032 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 19:00:05.335266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.19.155.252:37123)
0811 19:00:05.335482 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 19:00:05.335491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 19:00:05.339574 (+ 4083us) server_negotiation.cc:407] Connection header received
0811 19:00:05.339737 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 19:00:05.339742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 19:00:05.339847 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 19:00:05.339943 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 19:00:05.340609 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.341621 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.343849 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 19:00:05.344485 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 19:00:05.344584 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 19:00:05.345249 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 19:00:05.345351 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 19:00:05.345474 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 19:00:05.345628 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 19:00:05.345722 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 19:00:05.350412 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25526
I20260811 19:00:05.351539 25632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:05.466024 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25526
W20260811 19:00:05.501582 25792 connection.cc:535] server connection from 127.0.0.1:36668 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 19:00:05.501590 25671 connection.cc:535] server connection from 127.0.0.1:55140 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 19:00:05.502116 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25647
I20260811 19:00:05.503337 25748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:05.615370 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25647
I20260811 19:00:05.648437 20079 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVECISF/build/asan/bin/kudu pid 25769
I20260811 19:00:05.649721 25861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 19:00:05.763761 20079 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVECISF/build/asan/bin/kudu with pid 25769
2026-08-11T19:00:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5353 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10671 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (383727 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST